Re: query if queue exist and get it like getOrCreateCache

2019-11-14 Thread Mikael
Hi! If there is a queue created already with the name "abc" it will just return that queue, if it cannot find it and you have included a configuration it will create it. Mikael Den 2019-11-14 kl. 13:30, skrev Narsi Reddy Nallamilli: Hi Mikael, Do you mean the 4th statement will not create

Re: Is there a way to convert a cache (setup from the XML config file) to a table that we can query?

2019-11-14 Thread Ilya Kasnacheev
Hello! You can't inspect data with SQL if table not present, but you can use ScanQuery for that. You can't add tables to already existing caches, unfortunately. Regards, -- Ilya Kasnacheev ср, 13 нояб. 2019 г. в 21:35, devinbost : > Hi, > > We set up a cache in the default-config.xml file,

Re: how to find out if rebalance is in progress in the cluster?

2019-11-14 Thread Ilya Kasnacheev
Hello! I think you can listen for REBALANCE_STARTED/REBALANCE_STOPPED events. Just don't forget to turn them 'on' in nodes' configurations. Regards, -- Ilya Kasnacheev пн, 11 нояб. 2019 г. в 09:51, novacean.alex : > Hi, is there a way to find out if there is a rebalance process going on in

unsubscribe

2019-11-14 Thread Kurt Semba
Kurt Semba Principal Software Engineer / Extreme Networks GmbH kse...@extremenetworks.com Phone: +49 (0)69 4 786 0-136 Mobile: +49 (0)172 66 399 53

Re: Ignite.Net Read through approach - error : could not create .Net cachestore

2019-11-14 Thread Sudhir Patil
Alexandr, Unfortunately I don't have stacktrace because of work restrictions but I will try to send by typing. Yes class is present for cachestore on server node. Regards, Sudhir On Thursday, November 14, 2019, Alexandr Shapkin wrote: > Sudhir, > > > > Can you share a stacktrace? > > > >

Re: Ignite.Net Read through approach - error : could not create .Net cachestore

2019-11-14 Thread Sudhir Patil
Mikael, The client should not have to pass any cache configuration, once the cache is created in the server, you should just be able to get the cache Yes exactly this is my understanding also. What I am trying is call get operation on a key in cache for 1st time from client node as per my

Ignite.net get grid / node metrics

2019-11-14 Thread Sudhir Patil
Hi All, How to get grid / node metrics (e.g. memory used, etc) in Ignite.net? Regards, Sudhir -- Thanks & Regards, Sudhir Patil, +91 9881095647.

Re: Managing apache-ignite under Kubernetes

2019-11-14 Thread Humphrey
We did the same, creating a pod with the following configuration: And then we point to the visor command (startvisor.sh) where we pass the config file: In the environment, we are passing the project name, I think in your case you're using default namespace, so you can put there default. We

Re: How to query existing cache that was configured via XML

2019-11-14 Thread devinbost
ilya.kasnacheev wrote > It's not possible to add table to cache. > > It is possible to define cache with table(s) from XML, but you will have > to > populate it with data from scratch: > https://apacheignite.readme.io/docs/indexes Am I able to use the QueryCursor on a cache that was created

RE: Re: How to query existing cache that was configured via XML

2019-11-14 Thread Alexandr Shapkin
Please, have a look at examples/datagrid/CacheQueryExample.java  file. From: devinbostSent: Friday, November 15, 2019 1:31 AMTo: user@ignite.apache.orgSubject: Re: How to query existing cache that was configured via XML ilya.kasnacheev wrote> It's not possible to add table to cache.> > It is

Re: How do we delete caches?

2019-11-14 Thread devinbost
devinbost wrote > When we create a new table via SQL, it creates the cache for the table (as > expected). However, if we drop the table, the cache is not deleted. We > can't > figure out how to delete the cache. So, we have many caches accumulating > that we can't delete but can't use for SQL

RE: Set the partitions when create table in the code

2019-11-14 Thread codeboyyong
Hi Alexandr, Thanks for the fast reply. After I use the template in the create table sql statement, It works, I can set the partition numbers through affinity property . Thanks so much for you help. Really appreciate it . Yong -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: Ignite.net get grid / node metrics

2019-11-14 Thread Alexandr Shapkin
 It depends on what kind of information are you interested in. For sample, you can use the Cluster API to inspect a node’s metrics manually [1].Or take a look at some monitoring tools, like WebConsole [2]. [1] -

Set the partitions when create table in the code

2019-11-14 Thread codeboyyong
Hi Dear ignite friends I have a uniq use case here . I have to create a table in a big ignite cluster and since the columns and table name are dynamically generated. I can not config the cache config in the xml. So I use the SQL to create the table . The thing is , seems there is no way to config

How do we delete caches?

2019-11-14 Thread devinbost
When we create a new table via SQL, it creates the cache for the table (as expected). However, if we drop the table, the cache is not deleted. We can't figure out how to delete the cache. So, we have many caches accumulating that we can't delete but can't use for SQL because we've deleted their

RE: Set the partitions when create table in the code

2019-11-14 Thread Alexandr Shapkin
Have you tried a cache template [1]? After you designed your custom affinity function, you can configure it for a new cache template.You could use it with the CREATE TABLE statement [2].Please, note, that a template should be registered in advance. [1] -

Re: query if queue exist and get it like getOrCreateCache

2019-11-14 Thread Narsi Reddy Nallamilli
Thank you Mikael. On Thu, Nov 14, 2019 at 7:05 PM Mikael wrote: > Hi! > > If there is a queue created already with the name "abc" it will just > return that queue, if it cannot find it and you have included a > configuration it will create it. > > Mikael > Den 2019-11-14 kl. 13:30, skrev Narsi

Re: Question about memory when uploading CSV using .NET DataStreamer

2019-11-14 Thread camer314
Here is my source file and a 1 million row CSV file. I am not sure whats different between my code and yours but my version quickly consumes memory on the client side for some reason. Caveat, I am normally a Python programmer so i might have missed something obvious...

Re: Ignite.net get grid / node metrics

2019-11-14 Thread Sudhir Patil
Alexandr thank you. I will explore on 1) What are API ways to get details for individual nodes ? For 2) is gridgain a licensed version ? On Friday, November 15, 2019, Alexandr Shapkin wrote: > > > It depends on what kind of information are you interested in. > > > > For sample, you can use

Re: Question about memory when uploading CSV using .NET DataStreamer

2019-11-14 Thread camer314
In my sample code i had a bit of a bug, this should be the line to add: var _ = ldr.AddData(id++,data); However it doesnt appear to make any difference, this is the state of memory (with ignite.exe being my client executable). This is paused after insertion of 1 million rows, why is my client

Managing apache-ignite under Kubernetes

2019-11-14 Thread Miguel Díaz
Hi all I'm installing a persistence apache-ignite in Kubernetes using the Chart available in the official web. After some troubleshooting 2 nodes of ignite are running and some SQL DBs were created with their caches. The method used to discover nodes is based in auto-discovery of Kubernetes.

Re: External ignite node is left outside when ignite cluster is restarted

2019-11-14 Thread Narsi Reddy Nallamilli
Thank you IIlya. On Tue, Nov 12, 2019 at 7:01 PM Ilya Kasnacheev wrote: > Hello! > > I think you can do that, just listen to EVT_NODE_SEGMENTED and > EVT_NODE_LEFT events. > > You can also use SegmentationPolicy of RESTART_JVM. > > Regards, > -- > Ilya Kasnacheev > > > пн, 11 нояб. 2019 г. в

query if queue exist and get it like getOrCreateCache

2019-11-14 Thread Narsi Reddy Nallamilli
Hi! I am looking for some method just like getOrCreateCache available for queue. Any help!

Re: Question about memory when uploading CSV using .NET DataStreamer

2019-11-14 Thread Mikael
Hi! If each row is stored as an entry in the cache you can expect an overhead of around 200 byte per entry, so 200MB just for the actual entries (1M) not counting your data (more if you have any index). You can control the streamer, how much data and when it should be flushed, I have no

Re: query if queue exist and get it like getOrCreateCache

2019-11-14 Thread Mikael
What is wrong with Ignite.queue() ? |queue (String

RE: Re: Ignite.Net Read through approach - error : could not create .Net cachestore

2019-11-14 Thread Alexandr Shapkin
Sudhir, Can you share a stacktrace? It’s difficult to locate the problem without the details.According to source code, the exception is thrown when .NET side is unable to create a CacheStore instance.Since you have configured a factory, please, check that it returns a correct instance and the

Re: Question about memory when uploading CSV using .NET DataStreamer

2019-11-14 Thread Pavel Tupitsyn
Sounds nasty, can you share a reproducer please? On Thu, Nov 14, 2019 at 10:12 AM camer314 wrote: > I have a large CSV file (50 million rows) that i wish to upload to a > cache. I > am using .NET and a DataStreamer from my application which is designated as > a client only node. > > What i dont

Re: Question about memory when uploading CSV using .NET DataStreamer

2019-11-14 Thread Pavel Tupitsyn
Here is what I tried: https://gist.github.com/ptupitsyn/7dacefd1cebb936d5f516d8afeba7efe Ran for a minute or so, 200Mb used on client, 5Gb on server, seems to work as expected to me. On Thu, Nov 14, 2019 at 2:14 PM Pavel Tupitsyn wrote: > Sounds nasty, can you share a reproducer please? > > On

Re: query if queue exist and get it like getOrCreateCache

2019-11-14 Thread Narsi Reddy Nallamilli
Hi Mikael, Do you mean the 4th statement will not create new Queue? and would point to ig CollectionConfiguration colCfg = new CollectionConfiguration(); colCfg.setCollocated(true); IgniteQueue ig = ignite.queue("abc",0,colCfg); IgniteQueue ig1 = ignite.queue("abc",0,colCfg); On Thu, Nov 14,

Re: recoveryBallotBoxes in MvccProcessorImpl memory leak?

2019-11-14 Thread mvkarp
Hi, after investigating I have few questions regarding this issue. 1. Having lack of knowledge in what MVCC coordinator is used for, are you able to shed some light on the role and purpose of the MVCC coordinator? What does the MVCC coordinator do, why is one selected? Should an MVCC coordinator

Re: resetLostPartitions is blocked inside event listener

2019-11-14 Thread Akash Shinde
Thank you Ilya. On Fri, Nov 8, 2019 at 12:43 AM Ilya Kasnacheev wrote: > Hello! > > Event listener is invoked synchronously from internal threads. If > partition reset has to happen from the same thread, then obviously there > will be a deadlock. > > Cache listeners have same property, i.e.,

Re: Question about memory when uploading CSV using .NET DataStreamer

2019-11-14 Thread Ilya Kasnacheev
Hello! Since we're in 2019, we don't recommend running any Ignite nodes with -Xmx2G (that is, 2 gigabytes of heap allowance). It is certainly possible to run Ignite with less heap, but the reasoning of such is not very clear. Please also note that our JDBC thin driver supports streaming, and it