RE: Batch insert into ignite

Thanks Mikhail...will try the same and get back to you.. -Original Message- From: Mikhail [mailto:michael.cherka...@gmail.com] Sent: Monday, July 23, 2018 10:32 PM To: user@ignite.apache.org Subject: Re: Batch insert into ignite Hi Sriveena, for data load you can try to use streaming

RE: UnsupportedOperationException when updating a field in binary object

Thank you for the reply. You are right. The function used to initially get the set returns an unmodifiableSet. That is the reason for the error. However, when we use a Map as a field and initially write an unmodifiableMap, we can still modify the Map using getField. The code is like how we use

Re: UnsupportedOperationException when updating a field in binary object

This test stops working though if you replace line 30 with this: builder.setField("set", Collections.unmodifiableSet(Sets.newHashSet("a", "b", "c"))); If unmodifiable set is written, it's then read as unmodifiable set as well, and therefore can't be modified. I believe this is the reason for the

Re: Can wal archive be deleted?

Hello, I would definitely not advice you to delete the whole directory. If you need to reduce the space being consumed by wal archive, I'd suggest to play with configuration parameters like walHistorySize, once you will try to archive new wal segment to a full wal archive, oldest files will be

Re: UnsupportedOperationException when updating a field in binary object

You should update a Set field exactly the way you do it now. Could you please share full reproducer, as the attached code works perfectly. BinaryObjectSetUpdate.java -- Sent from:

UnsupportedOperationException when updating a field in binary object

Hi, I use a Set class as a field. When I update the field via the BinaryObjectBuilder, I get an UnsupportedOperationException. I use QueryEntity to set the field like: fieldNameTypeMap.put(tags_FieldStr, Set.class.getName()); Then my update function (in my EntryProcessor) is like:

Re: Batch insert into ignite

Hi Sriveena, for data load you can try to use streaming mode for jdbc: https://apacheignite.readme.io/docs/jdbc-driver#section-streaming-mode it will provide faster insert operation compare to regular insert, also you can disable WAL:

RE: Ignite threads in wait/park; cache stops responding

I will try the expiry policy thing. We currently have some dependences in our app that prevent us from going to jdk 1.8; we’ll have to go do some larger refactoring/upgrades first before we can try 2.6, but looks like that’s what we may have to do. Thanks for your input. I’ll come back if

Re: Ignite threads in wait/park; cache stops responding

Hi Lewisc, Please try to upgrade ignite to latest version 2.6, I think it makes sense to investigate this problem only with the latest version of Ignite. Please share with us logs from all nodes and take stack traces from all nodes too. Thanks, Mike. -- Sent from:

RE: Ignite threads in wait/park; cache stops responding

Hi, I’d suggest try upgrading from 2.2 to 2.6. One thing that stands out in your configs is expiryPolicy settings. expiryPolicy property was deprecated, you need to use expiryPolicyFactory instead. I happen to have recently shared a sample of setting it in an XML config on SO:

RE: Implementing custom affinity logic

Hi, I think all you need is to store (a+b)/c in a separate field of the key and annotate it with @AffinityKeyMapped: class Key { private long a, b, c; @AffinityKeyMapped private long affKey; public Key(long a, long b, long c) { this.a =

Re: Random-LRU-2 ?

>For random-lru and random-lru-2, algorithm randomly selects 5 indexes. Why 5? well, I don't know about how this number has been chosen. The only I can say it works fine. >Can I change this number? there's no way to configure it. >And we evict the index which |last_1 - last_2| is max? Am i

Ignite threads in wait/park; cache stops responding

Hi, We are trying to convert our app to use Ignite in place of our current caching implementation(ifinispan). It will work fine for an hour or so, and then things begin to fall apart. Eventually all our applications AJP threads will be blocked waiting on ignite to retrieve cached objects. We

Implementing custom affinity logic

Hi I m working on an ignite project where I want to have certain records to be collocated based on a custom calculated value which is obtained from the fields of the primary key object. For example the Primary key pojos have fields a,b,c. I want all records having same value of (a+b)/c

Re: ignite odbc - Cannot open include file: 'openssl/ssl.h': No such file or directory

Hello! I think that Ignite ships with binary builds of ODBC driver for Windows, under platforms\cpp\bin\odbc. Otherwise, if you really want to build it, you will need OpenSSL library. Regards, -- Ilya Kasnacheev 2018-07-23 17:05 GMT+03:00 wt : > i have downloaded and trying to build the

RE: Does event listener keep the order of events as they occur on the cluster?

Hello, For continuous queries I understand that I need to provide a filter (the query) , but I want to get all the updates (put operations) for a specific cache (not just some that pass a filter). Is this possible? Thank you, Remus Sent with BlackBerry Work (www.blackberry.com)

Re: Java API for SQL queries

Hi Maxim, It doesn't matter, which cache you will use for SQL queries here, so, yes, you can use some dummy cache. In future, afaik, there are plans to change this API, the method will be placed in Ignite class instead of IgniteCache. Regards, Evgenii 2018-07-23 17:41 GMT+03:00 Maxim Malygin :

Java API for SQL queries

Hi, I have the question regarding Java API for SQL queries. As I understand from the documentation, API for SQL queries is placed in IgniteCache interface ("query" method). This means that I need to get or create a cache to do a SQL query. What cache name I should use to get instance of

ignite odbc - Cannot open include file: 'openssl/ssl.h': No such file or directory

i have downloaded and trying to build the odbc project but it is referencing the following files that are not in the visual studio project ssl_bindings.h and ssl_gateway.cpp #include #include #include error is Error C1083 Cannot open include file: 'openssl/ssl.h': No such file or

Re: Waiting too long, to load 7k datas to cache.... And Client gets null value

Hello! Can you please provide the thread dump while running this code? Note that 10M is a very very small number for a memory model and it might affect your case. Also note that cache.get() should absolutely not return "cache is not ready" if the cache is already created but not populated yet.

Re: Ignite Cluster behind one Public IP address

Hello! Apache Ignite is pretty flexible in this regard, i.e. you can have two nodes both exposing JDBC on different ports. But still you won't able to add an Ignite node to cluster which is visible from one IP without massive configuration & tunnelling effort. Regards, -- Ilya Kasnacheev

RE: OptimizedMarshaller instead of BinaryMarshaller is usedforScanQuery

Hello! I have filed a ticket against Apache Ignite JIRA: https://issues.apache.org/jira/browse/IGNITE-9054 Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Apache Ignite Geospatial C# Samples

Thank you very much Roman for your quick response. Regards, Hemasundar. On 23 July 2018 at 16:39, Roman Guseinov wrote: > Hi Hemasundar, > > Ignite geospatial library (ignite-geospatial) depends on JTS that is > available under the LGPL license that is not aligned with Apache license > and >

Batch insert into ignite

Hi, How can we perform batch insert/update into ignite tables (created through sqlquery fields as create table)? Thanks & Regards, Sriveena

Re: Apache Ignite Geospatial C# Samples

Hi Hemasundar, Ignite geospatial library (ignite-geospatial) depends on JTS that is available under the LGPL license that is not aligned with Apache license and prevents from including ignite-geospatial into Apache Ignite binary deliveries [1]. I think that is why Ignite does not support

Performance issue with Outer Join

Hi, Whenever I use a String field (indexed) in the join condition of a LEFT/RIGHT OUTER JOIN, the query takes a lot of time (seconds) to return the result. However, this does not happen when a Long field is used. Please let me know if I'm missing something here. The fields are described as below

Can wal archive be deleted?

The default config of Ignite is to store wal archive in 20 checkpoints. So with the growing size of wal archive folder(336GB already while the data folder is only 73GB on one node), can these archive files be deleted without impacting the data integrity? -- Sent from:

Re: Apache Flink Sink + Ignite: Ouch! Argument is invalid

Hello Saikat, Thanks for the fix. I validated this fix by running my WordCount application in both standalone mode and cluster mode. The data can be inserted. But I found another problem here. The data written into Ignite is not correct. My application counts the word occurrence in this the

Waiting too long, to load 7k datas to cache.... And Client gets null value

Here is the config file:

If the authenticationEnabled is true Ignite web control conneced failed

If the attribute is opened, an error is reported when starting the monitoring cluster using the official web control platform Agent configuration: User's security tokens: 5NfQ URI to Ignite node REST server: http://127.0.0.1:9380 URI to Ignite Console server :

Apache Ignite Geospatial C# Samples

Hi All, If anyone worked/working/knows about Apache Ignite Geospatial search using C#.Net please provide sample code (or links). I am exploring to us Apache Ignite Geospatial search in our current application. Thanks and Regards, Hemasundar.

Random-LRU-2 ?

For random-lru and random-lru-2, algorithm randomly selects 5 indexes. Why 5? Can I change this number? And I am a little bit confused in random-lru-2. This case works: For selecting 5 indexes, we look the last 2 timestamp(let's say last_1 and last_2) values for each indexes. And we evict the