rebalancing & K8

2021-04-26 Thread narges saleh
Hi folks If I am deploying my ignite cluster using AKS, is defining the auto discovery service sufficient? I am following this link: https://ignite.apache.org/docs/latest/installation/kubernetes/azure-deployment Specifically, I am concerned about ignite's node/partition rebalancing in case of

EVT_CACHE_REBALANCE_STARTED

2021-03-31 Thread narges saleh
Hello Folks When does the event EVT_CACHE_REBALANCE_STARTED get triggered? Upon a successful start of a rebalancing process? If the rebalancing process fails to start due to some, issue say, partition exchange issue, when I still get the EVT_CACHE_REBALANCE_STARTED event if I am listening to it?

wal issues

2021-03-01 Thread narges saleh
Hi All, What could be the reason for the wal folder filling up and the message "too big size of WAL without checkpoint"? Too small or too big checkpoint interval or buffer? [2021-02-28 09:12:12,9811][INFO ][db-checkpoint-thread-#108][GridCacheDatabaseSharedManager] Checkpoint started

Re: Ignite 2.81. - NULL pointer exception

2021-02-18 Thread narges saleh
Was there a resolution for this issue? On Mon, Sep 7, 2020 at 9:40 AM Ilya Kasnacheev wrote: > Hello! > > I wonder why there's no stack traces for all the threads. > > I wonder if somebody from the development side will step in (2.8.1): > > [05:57:16,193][SEVERE][sys-stripe-15-#16][] Critical

Re: rebalancing and jobs

2021-01-13 Thread narges saleh
To clarify, I do not want to pause rebalancing. I want to see if a rebalancing job is in progress, delay my job and a rebalancing job is not in progress, delay any upcoming rebalancing job, till my job is finished. On Wed, Jan 13, 2021 at 5:04 PM narges saleh wrote: > Thanks Alex. I will st

Re: rebalancing and jobs

2021-01-13 Thread narges saleh
Thanks Alex. I will study the links you provided. I need to deal with rebalancing programmatically. On Wed, Jan 13, 2021 at 4:33 PM akorensh wrote: > Hi, > You can monitor using JMX as described here: > > https://ignite.apache.org/docs/latest/monitoring-metrics/metrics#monitoring-rebalancing

rebalancing and jobs

2021-01-13 Thread narges saleh
Hi All, What is the best practice regarding partition rebalancing and jobs? 1) Before I start a job, how do I check whether a rebalancing process is in progress? 2) If no rebalancing is in progress, how do I delay or pause upcoming rebalancing processes until my job is finished, assuming I don't

Re: SqlFieldsQuery With Variable Number of Arguments

2021-01-11 Thread narges saleh
Thanks Alex. I am not sure this answers my question. My question: How do I dynamically set the arguments in setArgs of SqlFieldsQuery. For example: sql1 = "select a,b,c from table x where age >?" sql2 = "select a,b,c from table x where age >? and salary < ?" sql3 = "select a,b,c,d from table x

SqlFieldsQuery With Variable Number of Arguments

2021-01-11 Thread narges saleh
Hi All, How do I set the arguments for the SqlFieldsQuery if I have a variable number of arguments? E.g., String sql = ; // can have variable number of arguments, i.e., "?". SqlFieldsQuery q = new SqlFieldsQuery(sql); q.setArgs(...); I am sorry if this is a trivial question but I don't seem

expiry policy

2020-11-30 Thread narges saleh
Hi All, I understand that expiry policy applies to off heap cache along with the persistent durable storage. Is there a way to apply different expiry policy to cache and disk? I need to retain the data on disk a lot longer than I can afford in cache. thanks.

Re: Caches, Regions, Expiry, Eviction

2020-11-19 Thread narges saleh
heev > > > пн, 16 нояб. 2020 г. в 15:55, narges saleh : > >> Hi All, >> >> I need confirmation for my understanding of some basic concepts. >> These are my understanding. Please confirm. >> 1) Regions are not applicable to on heap caches. I'd use JV

Caches, Regions, Expiry, Eviction

2020-11-16 Thread narges saleh
Hi All, I need confirmation for my understanding of some basic concepts. These are my understanding. Please confirm. 1) Regions are not applicable to on heap caches. I'd use JVM -Xms and -Xmx to set the limits, while with off heap caches, I'd use regions with initial/max size set. 2) When I

Re: Execution of local SqlFieldsQuery on client node disallowed

2020-11-01 Thread narges saleh
ired node. If the cluster topology changes > while the task was running you can re-submit it to ensure the result is > accurate. > > - > Denis > > > On Fri, Oct 30, 2020 at 2:16 PM narges saleh wrote: > >> Hi Denis, >> >> My problem with using affinity call/run i

Re: Execution of local SqlFieldsQuery on client node disallowed

2020-10-30 Thread narges saleh
:31 AM narges saleh wrote: > Thanks Ilya, Denis for the feedback. > > On Mon, Oct 26, 2020 at 1:44 PM Denis Magda wrote: > >> Narges, >> >> Also, keep in mind that if a local query is executed over a partitioned >> table and it happens that partitions rebalanc

Re: IgniteAtomicSequence

2020-10-28 Thread narges saleh
getting-metrics > > вт, 27 окт. 2020 г. в 21:50, narges saleh : > >> Questions: >> I know I should take into account the cluster size and the data volume, >> but how bad is the overhead of IgniteAtomicLong? Any benchmarking? >> What are the use cases for IgniteAt

Re: IgniteAtomicSequence

2020-10-27 Thread narges saleh
Questions: I know I should take into account the cluster size and the data volume, but how bad is the overhead of IgniteAtomicLong? Any benchmarking? What are the use cases for IgniteAtomicSequence if it does not guarantee ordering? thanks. On Tue, Oct 27, 2020 at 10:27 AM narges saleh wrote

Re: Execution of local SqlFieldsQuery on client node disallowed

2020-10-27 Thread narges saleh
l queries. >> >> You need to use Ignite Thin JDBC driver: jdbc:ignite:thin:// >> Then you can do local queries. >> >> Regards, >> -- >> Ilya Kasnacheev >> >> >> сб, 24 окт. 2020 г. в 16:04, narges saleh : >> >>> Hello Ily

Re: IgniteAtomicSequence

2020-10-27 Thread narges saleh
nerate unique numbers but it > doesn't guarantee ordering. > If you need ordering you could set the reserve size to 1 or use > IgniteAtomicLong. > > Thanks, > Pavel > > вс, 25 окт. 2020 г. в 05:00, narges saleh : > >> Hi All, >> What is the consequence of dat

IgniteAtomicSequence

2020-10-24 Thread narges saleh
Hi All, What is the consequence of data rebalancing across nodes as far as IgniteAtomicSequence and the reserve on each node is concerned? For example, if the last sequence number is 6000 in one node and the record moves to a node whose last sequence number is 1000? Do the reserves on both nodes

Re: Execution of local SqlFieldsQuery on client node disallowed

2020-10-24 Thread narges saleh
t 23, 2020 at 10:31 AM Ilya Kasnacheev wrote: > Hello! > > Does this happen every time? If so, do you have a reproducer for the issue? > > Regards, > -- > Ilya Kasnacheev > > > пт, 23 окт. 2020 г. в 13:06, narges saleh : > >> Denis -- Just checked. I do spec

Re: Execution of local SqlFieldsQuery on client node disallowed

2020-10-23 Thread narges saleh
Denis -- Just checked. I do specify my services to be deployed on server nodes only. Why would ignite think that I am running my code on a client node? On Fri, Oct 23, 2020 at 3:50 AM narges saleh wrote: > Hi Denis > What would make an ignite node a client node? The code is invok

Re: Execution of local SqlFieldsQuery on client node disallowed

2020-10-23 Thread narges saleh
ervice is deployed on the client node), > then the local flag has no effect because client nodes don't keep your data > locally but rather consume it from servers. > > - > Denis > > > On Thu, Oct 22, 2020 at 6:26 PM narges saleh wrote: > >> Hi All, >>

Execution of local SqlFieldsQuery on client node disallowed

2020-10-22 Thread narges saleh
Hi All, I am trying to execute a sql query via a JDBC connection on the service node (the query is run via a service), but I am getting *Execution of local SqlFieldsQuery on client node disallowed.* *The JDBC connection has the option local=true as I want to run the query on the data on the local

apache ignite 2.9

2020-10-13 Thread narges saleh
Hi All, Any timeline for apache ignite 2.9 release? thanks.

Re: Continuous Query

2020-10-07 Thread narges saleh
he.QueryContinuous > (qry: new ContinuousQuery<[..KeyType..], > [...ValueType...]>(listener) {Local = true}, > initialQry: new ScanQuery< [..KeyType..], [...ValueType...] > > {Local = true}); > > On Thu, Oct 8, 2020 at 9:53 AM narges saleh

Re: Continuous Query

2020-10-07 Thread narges saleh
ord that is being modified >> and passed into a filter. Hmm, it's also said that the filter can be >> executed on a backup node. Check if it's true, and then you need to add a >> special check into the filter that would allow executing the logic only if >> it's the primary node: >>

Re: Continuous Query

2020-10-07 Thread narges saleh
mpute task once in a while >>- Read all the latest records that satisfy the requests with SQL or >>any other APIs >>- Complete the calculation, mark already processed records just in >>case if everything is failed in the middle and you need to run the >&

Re: Continuous Query

2020-10-07 Thread narges saleh
e the calculation, mark already processed records just in >case if everything is failed in the middle and you need to run the > calculation from scratch > > > - > Denis > > > On Mon, Oct 5, 2020 at 8:33 PM narges saleh wrote: > >> Denis >> The calculat

Re: Continuous Query

2020-10-05 Thread narges saleh
- Does that calculation change the state of the record (updates any >fields)? >- Does the calculation read or update any other records? > > - > Denis > > > On Sat, Oct 3, 2020 at 1:34 PM narges saleh wrote: > >> The latter; the server needs to perform some calcu

Re: Continuous Query

2020-10-03 Thread narges saleh
cation? Or is it more like a server > detects and does some calculation logically without updating the app. > > - > Denis > > > On Fri, Oct 2, 2020 at 11:22 AM narges saleh wrote: > >> The detection should happen at most a couple of minutes after a record is >> inserted in

Re: Continuous Query

2020-10-02 Thread narges saleh
hat are your requirements? Do you need to process the records as soon as > they are put into the cluster? > > > > On Friday, October 2, 2020, narges saleh wrote: > >> Thank you Dennis for the reply. >> From the perspective of performance/resource overhead and reliability

Re: Continuous Query

2020-10-02 Thread narges saleh
ching use case when it's ok to process > records together with some delay. > > > - > Denis > > > On Fri, Oct 2, 2020 at 3:50 AM narges saleh wrote: > >> Hi All, >> If I want to watch for a rolling timestamp pattern in all the records >> that get in

Continuous Query

2020-10-02 Thread narges saleh
Hi All, If I want to watch for a rolling timestamp pattern in all the records that get inserted to all my caches, is it more efficient to use timer based jobs (that checks all the records in some interval) or continuous queries that locally filter on the pattern? These records can get inserted

backup

2020-09-15 Thread narges saleh
hi all Is it possible to backup/restore cache content across ignite clusters? If not, how do I minimize data loss in case of an ignite cluster crash? I am already backing up the native persistence. thanks.

Re: Force backup on different physical machine

2020-07-21 Thread narges saleh
riable so Ignite can > find it > > On 21 Jul 2020, at 14:01, narges saleh wrote: > > Hi Stephen, > 1) [Having said that, you’re probably best configuring k8s not to put two > Ignite server nodes on a single machine.] > Do you mean by having k8s place the VMs in different ava

Re: Force backup on different physical machine

2020-07-21 Thread narges saleh
Hi Stephen, 1) [Having said that, you’re probably best configuring k8s not to put two Ignite server nodes on a single machine.] Do you mean by having k8s place the VMs in different availability zones? Then how would you tell ignite to place the backups in a different zone? I've read this is

native persistence

2020-07-14 Thread narges saleh
Hi All, I have read that it is a good idea to have wal, walarchive and data on separate drives. How about indexes? How would you specify the path for the indexes? Is the idea to specify the data and indexes on one drive and wal/walarchive on another? thanks.

Re: primary keys

2020-06-18 Thread narges saleh
ery plans. > > Regards, > -- > Ilya Kasnacheev > > > чт, 18 июн. 2020 г. в 16:11, narges saleh : > >> Thanks Ilya. >> Now I can see the complete plan, and it shows scanning the large tables >> (but not the others). Increasing index size didn't help. >> I only have

Re: primary keys

2020-06-18 Thread narges saleh
to change > its inline size other than specifying IGNITE_MAX_INDEX_PAYLOAD_SIZE > system property or environment variable. > > If it is of complex type, some versions may not be able to search by its > fields. > > Regards, > -- > Ilya Kasnacheev > > > чт,

primary keys

2020-06-18 Thread narges saleh
Hi All, Shouldn't primary keys result in indexes and if so, shouldn't I be able to see them when I list indexes? Does inline index size applicable to primary keys too? Additionally, when I do explain plan on a query which involves tables with primary keys, shouldn't I see the primary key/index

Re: sqlline

2020-06-18 Thread narges saleh
eadme.io/docs/performance-and-debugging > > - > Denis > > > On Wed, Jun 17, 2020 at 7:33 PM narges saleh wrote: > >> My selects are complex but they do use the primary keys for the >> partitioned tables/caches participating in the query. But they perform >> po

Re: sqlline

2020-06-17 Thread narges saleh
My selects are complex but they do use the primary keys for the partitioned tables/caches participating in the query. But they perform poorly if the data is distributed across multiple nodes. On Wed, Jun 17, 2020 at 8:04 PM narges saleh wrote: > Thanks Denis. In case of selects, can I p

Re: sqlline

2020-06-17 Thread narges saleh
en > you try to get records based on the value of a primary key, such as "SELECT > * FROM Table WHERE primaryKeyColumn = 2". > > - > Denis > > > On Wed, Jun 17, 2020 at 12:43 PM narges saleh > wrote: > >> Thanks Denis. Will watch the video. >> One more qu

Re: sqlline

2020-06-17 Thread narges saleh
our SQL capabilities in detail: > https://www.youtube.com/watch?v=eYV-tNLzIts > > - > Denis > > > On Wed, Jun 17, 2020 at 11:28 AM narges saleh > wrote: > >> Then can you please explain what the option collocated=true for JDBC url >> is for? >> Should I assum

Re: sqlline

2020-06-17 Thread narges saleh
PM Denis Magda wrote: > If the data is already co-located you don't need to pass in any other > parameters. > > - > Denis > > > On Wed, Jun 17, 2020 at 10:13 AM narges saleh > wrote: > >> Hi Denis. The tables are defined with affinity keys specified

Re: sqlline

2020-06-17 Thread narges saleh
s configured) and then just send your queries with > joins with no additional connection parameters. > > - > Denis > > > On Wed, Jun 17, 2020 at 9:33 AM narges saleh wrote: > >> Hi All, >> >> Is collocation enforced when SQL is issues in sqline command line or do I >> need to give the option when I start sqlline? >> >> thanks. >> >

sqlline

2020-06-17 Thread narges saleh
Hi All, Is collocation enforced when SQL is issues in sqline command line or do I need to give the option when I start sqlline? thanks.

PIVOT with SQL

2020-06-16 Thread narges saleh
Hi All, Is it possible to use pivot function with JDBC SQL used with apache ignite? If not, is there a function available with such a functionality? thanks

Re: ignite work dir

2020-06-11 Thread narges saleh
.g. logging subsystem is > configured to use /ignite/work. Need to see the exception. > > Regards, > -- > Ilya Kasnacheev > > > чт, 11 июн. 2020 г. в 17:55, narges saleh : > >> Hi All, >> >> What's the best way to set ignite's work dir on the client side, >>

ignite work dir

2020-06-11 Thread narges saleh
Hi All, What's the best way to set ignite's work dir on the client side, considering that the client and server nodes run under different users. I am setting both IGNITE_HOME and IGNITE_WORK_DIR system variables (on client), but I am still getting the exception "/ignite/work" cannot be created.

Re: join question

2020-05-22 Thread narges saleh
t; > > вт, 19 мая 2020 г. в 01:48, narges saleh : > >> It seems the issue exist only if one uses data streamer with binaryobject >> builder. If I use straight JDBC to insert data, the issue goes away. Any >> idea what one needs to do to get this working with binary o

JDBC Connection and stream receiver

2020-05-21 Thread narges saleh
Hi All, Is it possible to use stream receivers with JDBC connections (with streaming set to on)? If yes, can you point me to an example? thanks.

Re: join question

2020-05-18 Thread narges saleh
PM narges saleh wrote: > It turned out that I'd get partial results in some cases, when joining > partitioned caches. But I still don't understand why I am not getting all > the rows that the joined query should return. > My assumption is that if you have caches with primary keys

Re: join question

2020-05-18 Thread narges saleh
, a distributed join should be possible and I still should get all the rows. But this is not happening either. What could be the issue here? What am I missing here? On Mon, May 18, 2020 at 9:30 AM narges saleh wrote: > No error. Just no records is returned, as opposed to the join between the > repl

Re: join question

2020-05-18 Thread narges saleh
specific error message? Please > share details. > > Regards, > -- > Ilya Kasnacheev > > > пн, 18 мая 2020 г. в 16:49, narges saleh : > >> Hi All, >> I have encountered a puzzling join case. >> I have 3 tables on a cluster of two ignite server nodes: &g

join question

2020-05-18 Thread narges saleh
Hi All, I have encountered a puzzling join case. I have 3 tables on a cluster of two ignite server nodes: table-A (id + org = primary), replicated id org. <-- affinity other fields table-B (id, org, add-id=primary key), partitioned id org <- affinity addr-id other fields table-C (id, org,

Streamer with overwrite option

2020-05-17 Thread narges saleh
Hi All, I am going to get updates for the existing records in the cache, and currently don't have an update or upsert process in place. How expensive is a streamer with overwrite option set to true, assuming the cache has millions of records? I assume the streamer would compare the new entry

Re: Basic Affinity Question

2020-05-13 Thread narges saleh
ployee and address for the employee end up on the same node? In other words, I won't need to drag company id in the address table, in order to collocate all three record types. On Wed, May 13, 2020 at 10:50 AM narges saleh wrote: > Thanks. > If I try AffinityRun with collection of caches and the affin

Re: Basic Affinity Question

2020-05-13 Thread narges saleh
ing...@gridgain.com> wrote: > Yes, but you also need to make sure you use the correct affinityRun > method. There’s one where you specify multiple caches and you need to use > that one. > > > On 13 May 2020, at 12:50, narges saleh wrote: > > > > Hi All, > > If

Basic Affinity Question

2020-05-13 Thread narges saleh
Hi All, If I have these two caches/tables defined via query entities, in a config file, Employee (partitioned) employee-id company-id name primary key(employee-id, company-id), affinity(company-id) Company (partitioned) company-id. name primary key(company-id) If I do AffinityRun

Re: Schema Questions

2020-05-12 Thread narges saleh
it makes sense to > use it as a key, there is no need to generate an additional field for this. > > Evgenii > > пн, 11 мая 2020 г. в 09:20, narges saleh : > >> Hi All, >> >> I would appreciate your feedback, for the following, in terms of >> performance for both inserts

Schema Questions

2020-05-11 Thread narges saleh
Hi All, I would appreciate your feedback, for the following, in terms of performance for both inserts and queries. 1) Which one of these patterns is preferable for the table design? A- Have a fat table/cache with nested objects, e.g. person table with a hashmap of addresses. B- Have person and

Re: deployment pattern

2020-05-05 Thread narges saleh
Thank you Alex, for the valuable information. I understand that services have performance overhead, but isn't it the case at end of the day, a service is a piece of code that has to get executed on data and if collected with data, that one would get a better performance? Some of my services run

deployment pattern

2020-05-05 Thread narges saleh
Hi All, Is it a good practice to deploy the services where the data/compute is. In particular, I am interested if the data and services are deployed as microservices. Or should one goes with the filter based deployment? Both services and data/compute nodes will have high utilization. If services

Re: JDBC Connection Pooling

2020-05-01 Thread narges saleh
give you the better performance. This one streamer can be > used from multiple threads. > > чт, 16 апр. 2020 г. в 09:54, narges saleh : > >> I am sorry for mixing these two up. >> I am asking if I were to use binaryobject builder with datastreamer in >> place on jdbc

Re: JDBC Connection Pooling

2020-05-01 Thread narges saleh
t; used from multiple threads. > > чт, 16 апр. 2020 г. в 09:54, narges saleh : > >> I am sorry for mixing these two up. >> I am asking if I were to use binaryobject builder with datastreamer in >> place on jdbc connection would/should I create a pool of the streamer &g

Re: joins

2020-04-21 Thread narges saleh
Thanks Alex for the explanation. I guess, I will need to set the distributed join option to false, if the affinity is in action. But doesn't the primary keys result in indexes? If so, then the requirement for having an index should be satisfied, right? I am joining the two tables on the field,

joins

2020-04-21 Thread narges saleh
Hi All, I have defined two caches/tables: person and org. They are defined via query entities, and both have the same key fields. I have set the affinity on both tables. When I try to join the two tables, I get the following message [Failed to prepare distributed join query. Join condition does

Re: JDBC Connection

2020-04-21 Thread narges saleh
REAMING ON/OFF commands after opening a > connection with the driver: > https://apacheignite-sql.readme.io/docs/set > > - > Denis > > > On Sun, Apr 19, 2020 at 7:55 AM narges saleh wrote: > >> Actually, I still have issue with this. >> It seems I am n

Re: BinaryObject and CustomKey

2020-04-20 Thread narges saleh
or streaming. > > However, if you want to use java objects in future, you will need to change > keyType and keyType to the full name with a package. > > > Evgenii > > > пн, 20 апр. 2020 г. в 08:53, narges saleh : > >> Hi All, >> If I have a query entity defined with

BinaryObject and CustomKey

2020-04-20 Thread narges saleh
Hi All, If I have a query entity defined with composite CustomKey, how do I insert to the cache,here, Customer, via the DataStreamer, using binary object builder? Do I need to define an object for the composite CustomKey? I am trying to define all the tables/caches via the configuration file. How

Re: JDBC Connection

2020-04-19 Thread narges saleh
with streaming enabled, and leaving the cache out? The cache will be specified in the SQL. thanks. On Fri, Apr 10, 2020 at 6:47 AM narges saleh wrote: > Hi All, > I think I have figured it out. I just need to specify the schema. > thanks. > > On Thu, Apr 9, 2020 at 9:30 PM narg

Re: socketstreamer

2020-04-16 Thread narges saleh
I am seeing some hiccups, but that might be due to some other issues. I'll troubleshoot. thanks. On Thu, Apr 16, 2020 at 1:22 PM akorensh wrote: > Hi, >Not to my knowledge. Are you having any issues using it? > Thanks, Alex > > > > -- > Sent from:

Re: JDBC Connection Pooling

2020-04-16 Thread narges saleh
t;Are you saying have the data streamed to the streamer via multiple > connections, across multiple threads? > If you use just a simple IgniteDataStreamer, you can use it from multiple > threads(use addData from multiple threads) to increase the throughput. > Evgenii > > ср, 1

socketstreamer

2020-04-16 Thread narges saleh
Hi All, Is there an known or perceived issue deploying ignite's socketstreamer as an ignite service? thanks

Re: JDBC Connection Pooling

2020-04-15 Thread narges saleh
w for each cache)? > If you use just KV API, it's better to have only one data streamer per > cache and reuse it from multiple threads - it will give you the best > performance. > > Evgenii > > ср, 15 апр. 2020 г. в 04:53, narges saleh : > >> Please note that in my case

Re: JDBC Connection Pooling

2020-04-15 Thread narges saleh
Please note that in my case, the streamers are running on the server side (as part of different services). On Wed, Apr 15, 2020 at 6:46 AM narges saleh wrote: > So, in effect, I'll be having a pool of streamers, right? > Would this still be the case if I am using BinaryObjectBuilder to

Re: JDBC Connection Pooling

2020-04-15 Thread narges saleh
ng, since the pool size depends on the lot of things > > вт, 14 апр. 2020 г. в 07:31, narges saleh : > >> Yes, Evgenii. >> >> On Mon, Apr 13, 2020 at 10:06 PM Evgenii Zhuravlev < >> e.zhuravlev...@gmail.com> wrote: >> >>> Hi, >>> >&g

Re: JDBC Connection Pooling

2020-04-14 Thread narges saleh
Yes, Evgenii. On Mon, Apr 13, 2020 at 10:06 PM Evgenii Zhuravlev wrote: > Hi, > > Do you use STREAMING MODE for thin JDBC driver? > > Evgenii > > пн, 13 апр. 2020 г. в 19:33, narges saleh : > >> Thanks Alex. I will study the links you provided. >> >

JDBC Connection Pooling

2020-04-12 Thread narges saleh
Hi All, Do I need to create a JDBC connection pool for my SQL queries, in particular the inserts via the ignite data streamer? I am not able to find a consistent answer to this question. thanks.

Re: JDBC Connection

2020-04-10 Thread narges saleh
Hi All, I think I have figured it out. I just need to specify the schema. thanks. On Thu, Apr 9, 2020 at 9:30 PM narges saleh wrote: > Hi All, > 1) How would one use ignite's JDBC connection to query multiple tables, > both in case of joins and separately? I.e., Can one get a JDBC c

JDBC Connection

2020-04-09 Thread narges saleh
Hi All, 1) How would one use ignite's JDBC connection to query multiple tables, both in case of joins and separately? I.e., Can one get a JDBC connection, and use it to query multiple caches? Another use case, is where a JDBC connection is used to query caches whose name is known at runtime. The

Re: ClassNotFoundException

2020-04-09 Thread narges saleh
te.sh/bat script to start the cluster nodes that will be > hosting the services? Only that script adds jars from the root of > "ignite/lib" directory to the classpath. > > - > Denis > > > On Wed, Apr 8, 2020 at 4:08 AM narges saleh wrote: > >> Hi All,

GridServiceMethodNotFoundException

2020-04-09 Thread narges saleh
Hi All, I am getting this exception in case of some of my services. According to javadoc, this exception is thrown when the service is not found. According to the ignite compute node log, the service is deployed (I have only one node) Executing distributed service: myService But when I try to

ClassNotFoundException

2020-04-08 Thread narges saleh
Hi All, I am deploying the jar that includes my services to ignite's libs directory on all the nodes but when I try to deploy the service, I still get ClassNotFoundException. Am I supposed to do something additional? thanks.

Re: Service Grid Requests

2020-04-08 Thread narges saleh
Thanks for the reply. If I make the resources thread safe, will the subsequent requests to the service be queued or ignite spawns a new service, or load balances, assuming that I deploy the service with node singleton or affinity option? On Mon, Apr 6, 2020 at 2:28 PM akorensh wrote: > Hi, > >

Service Grid Requests

2020-04-06 Thread narges saleh
Hi All, I understand that the ignite services are stateful. That being said, do I need to synchronize the objects in my services or ignite queues the requests to the same service, assuming that my services are deployed either as node signleton or based on some affinity key? thanks.

Re: Continuous Query Questions

2020-04-01 Thread narges saleh
t; will be able to find not processed entries. Otherwise, you will need to > register CQ again and process all the entries using initialQuery. > > Evgenii > > ср, 1 апр. 2020 г. в 13:16, narges saleh : > >> Thanks Evgenii for the recommendation and the heads up. >> >&g

Re: Continuous Query Questions

2020-04-01 Thread narges saleh
ronously. > > In case of using local CQ, there is a chance to miss notifications in case > of node failure, it's described in javadoc. > > Evgenii > > > вт, 31 мар. 2020 г. в 03:00, narges saleh : > >> Hi All, >> I'd like to get your feedback regarding the foll

Surrogate Keys and Ignite

2020-03-31 Thread narges saleh
Hi All, I also have a general question. Is it a good idea to have a surrogate key table in ignite? I want to avoid joins, and I don't want to use secondary indexes. I want to look up this surrogate key table (which should be very small in terms of volume and is replicated across all the nodes),

Continuous Query Questions

2020-03-31 Thread narges saleh
Hi All, I'd like to get your feedback regarding the following pattern. 1) CQ setup that listens to the changes to a cache on the local node only. 2) Upon receiving notification on a change, the listener makes additions to two other caches, one being on the local node (partitioned) and the other

Re: Query Entity and Affinity Key

2020-03-16 Thread narges saleh
Attached. thanks. On Mon, Mar 16, 2020 at 8:28 PM Evgenii Zhuravlev wrote: > Hi, please share the whole config file > > пн, 16 мар. 2020 г. в 15:38, narges saleh : > >> Thanks Evgenii for the reply. >> How do I do that in XML configuration file if my query entiti

Re: Query Entity and Affinity Key

2020-03-16 Thread narges saleh
have one cache per table(query entity) and configure separate > CacheKeyConfigurations for each of the caches. > > Evgenii > > пн, 16 мар. 2020 г. в 11:42, narges saleh : > >> Hi All, >> >> I have a question that might be trivial. >> If I define my

Query Entity and Affinity Key

2020-03-16 Thread narges saleh
Hi All, I have a question that might be trivial. If I define my query entity for each in the XML configuration file and define the affinity key via CacheKeyConfiguration (again in the xml file), considering that here affinity key is defined at IgniteConfiguration level, how do I specify which

Re: cache/table metadata

2020-03-13 Thread narges saleh
-binary-objects-using-binaryobjectbuilder > > - > Denis > > > On Thu, Mar 12, 2020 at 9:20 PM narges saleh wrote: > >> Hello Ilya >> Can you provide some links/examples on how to use >> ignite.binary().type(field-name)? >> thanks. >> >> On Thu,

Re: cache/table metadata

2020-03-12 Thread narges saleh
> > Regards, > -- > Ilya Kasnacheev > > > чт, 12 мар. 2020 г. в 18:05, narges saleh : > >> Thanks Ilya. >> >> Is there any utility that returns the (java) field types for the query >> entity defined caches? I don't want to have to map jdbc types to java

Re: cache/table metadata

2020-03-12 Thread narges saleh
> Please see > https://docs.oracle.com/javase/8/docs/api/java/sql/DatabaseMetaData.html > > Regards, > -- > Ilya Kasnacheev > > > чт, 12 мар. 2020 г. в 05:49, narges saleh : > >> Hi All, >> >> How would one extract, programmatically, the metadata for the

cache/table metadata

2020-03-11 Thread narges saleh
Hi All, How would one extract, programmatically, the metadata for the fields/columns for a cache/table? I want to get the field names along with the data type for each field, say, for example, if the table is defined via queryentity or SQL/JDBC. thanks.

Apache Ignite Upgrades

2020-03-05 Thread narges saleh
Hi All, I would appreciate your replies to following questions regarding various ignite upgrade scenarios. 1) How do I upgrade ignite without outage? Does it allow for rolling upgrades? 2) How do I add submit a new configuration file, say as a result of adding or modifying some new/existing

Spring JDBCTemplate with Ignite's DataStreamer

2020-03-04 Thread narges saleh
Hi All, Is it possible to set up a spring JDBCtemplate, using ignite JDBC URL connection with ignite data streamer enabled (for persistence to cache), something similar to following? jdbc:ignite:cfg://cache=PERSON:streaming=true:streamingFlushFrequency=2000

  1   2   >