Re: number of way segments in wal

2019-12-10 Thread krkumar24061...@gmail.com
Hi Anton - Initially we had the wal and wal archive configured to different folders, later we changed the config to the same folder and restarted the cluster. Is that a problem? Thanx and Regards, KR Kumar -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Understanding Write/Read IOPS during Ignite data load through Streamer and JDBC SQL

2019-12-10 Thread krkumar24061...@gmail.com
HI ilya - Thanx for the reply. What you said is exactly what's happening I guess. We do see this warning that pages will be rotated from disk and the write process will slow down. Here is the message that we see in the logs: WARN ][data-streamer-stripe-22-#59][PageMemoryImpl] Page replacements

Re: Adhoc Reporting use case (Ignite+Spark?)

2019-12-10 Thread sri hari kali charan Tummala
Check these examples. https://aws.amazon.com/blogs/big-data/real-time-in-memory-oltp-and-analytics-with-apache-ignite-on-aws/ Spark + ignite using thrift connection:-

Re: Ignite Hanging on startup after OOME

2019-12-10 Thread Mitchell Rathbun (BLOOMBERG/ 731 LEX)
We are running in LOCAL cache mode with persistence enabled. We were able to trigger the crash with large putAll calls and low off-heap memory allocated (persistence is enabled). It was IgniteOutOfMemory exception that occurred. I can try and get a thread dump and add it to this e-mail chain.

Re: IgniteOutOfMemoryException in LOCAL cache mode with persistence enabled

2019-12-10 Thread Mitchell Rathbun (BLOOMBERG/ 731 LEX)
2 GB is not reasonable for off heap memory for our use case. In general, even if off-heap is very low, performance should just degrade and calls should become blocking, I don't think that we should crash. Either way, the issue seems to be with putAll, not concurrent updates of different caches

Re: H2 version security concern

2019-12-10 Thread Evgenii Zhuravlev
Hi, There are plans to replace H2 with Calcite. You can read more about it on dev list, I've seen several threads regarding this topic there. Evgenii вт, 10 дек. 2019 г. в 13:29, Sobolevsky, Vladik : > Hi, > > > > It looks like all the recent versions of Apache Ignite ( apache ignite >

H2 version security concern

2019-12-10 Thread Sobolevsky, Vladik
Hi, It looks like all the recent versions of Apache Ignite ( apache ignite indexing) depends on H2 version 1.4.197. This version has at least 2 CVE’s : https://nvd.nist.gov/vuln/detail/CVE-2018-10054 https://nvd.nist.gov/vuln/detail/CVE-2018-14335 I do understand that not all above CVE’s can be

Geometry via SQL?

2019-12-10 Thread richard.ows...@viasat.com
Is there an example of how to use the SQL Interface to user SQL Insert of a GEOMETRY Data Type? The GEOMETRY data type is supported through the SQL interface (I can create a table with GEOMETRY field and create the necessary index), but cannot INSERT a geometry? -- Sent from:

Re: Topology version changing very frequently

2019-12-10 Thread Prasad Bhalerao
Can you please try to answer question 1, 2 and 3? In my logs I could see that number of server are also changing. Topology version changes when server node becomes 3 and again becomes 4. Total number of server nodes are 4. Thanks, Prasad On Tue 10 Dec, 2019, 11:45 PM akurbanov Hello, > > Are

Re: JVM crashed - Failed to get field because type ID of passed object differs from type ID this BinaryField belongs to

2019-12-10 Thread akurbanov
Hello, I would also recommend to check which objects are used here, grep through the binary_meta and marshaller (in $IGNITE_HOME/work) directories to identify the classes. You should see x.classname0 files for x equals to both numbers. Are both classes present? Are they used to be stored in same

Re: Topology version changing very frequently

2019-12-10 Thread akurbanov
Hello, Are you able to share full logs from the server and client instances? In short: by default clients can reconnect to the cluster after the network connection was disrupted by anything (network issues, gc pauses etc.).

Re: Client (weblogic) attempting to rejoin cluster causes shutdown.

2019-12-10 Thread Stanislav Lukyanov
Ok, there is a lot to dig through here but let me try with establishing simple things first. 1. If two nodes (client or server) have the same cache specified in the configuration, the configs must be identical. 2. If one node has a cache configuration, it will be shared between all nodes

Re: number of way segments in wal

2019-12-10 Thread akurbanov
Hello, One important question: if you can recall, did you start a clean cluster with WAL /WAL archive pointing to the very same directory, or you have stopped the node without WAL /PDS cleanup and changed this setting? So, when this configuration was applied, were there real WAL segment files in

Re: JVM crashed - Failed to get field because type ID of passed object differs from type ID this BinaryField belongs to

2019-12-10 Thread Ilya Kasnacheev
Hello! This time, the error is more specific, and it has to do with composition of your objects. It seems that you manage to put some objects in your cache which have different fields' types than the rest, and this interferes with building of indexes. This should normally be handled rather than

Re: Client (weblogic) attempting to rejoin cluster causes shutdown.

2019-12-10 Thread Ilya Kasnacheev
Hello! Unfortunately it's hard to say without looking at complete logs from your nodes. There's too many questions and not enough clues. Regards, -- Ilya Kasnacheev пт, 6 дек. 2019 г. в 03:56, Steven.Gerdes : > The production instance has issues with ignite heaping out, the solution we >

Re: What is the purpose of indexes in Cassandra table when they can not be queried?

2019-12-10 Thread Ilya Kasnacheev
Hello! I will give an alternative explanation. Even if Ignite will not go to the underlying database when doing its own SQL, it has to use underlying database to do readThrough, so underlying database should have an index on the cache key. If you only ever do writeThrough, I think you can go

Re: how to optimization this

2019-12-10 Thread Ilya Kasnacheev
Hello! These threads are idle. Maybe you also have non-idle threads, but not these. Yes, JVM reporting of thread state leaves a lot to be desired. Regards, -- Ilya Kasnacheev чт, 5 дек. 2019 г. в 09:38, ?青春狂-^ : > Hi > we have Performance testing capabilities for project, > the

Re: Adhoc Reporting use case (Ignite+Spark?)

2019-12-10 Thread Ilya Kasnacheev
Hello! I think you will have to provide way more details about your case before getting any feedback. Regards, -- Ilya Kasnacheev чт, 5 дек. 2019 г. в 00:07, Deepak : > Hello, > > I am trying out Ignite+Spark combination for my adhoc reporting use case. > Any suggestion/help on similar

Re: Understanding Write/Read IOPS during Ignite data load through Streamer and JDBC SQL

2019-12-10 Thread Ilya Kasnacheev
Hello! When you are writing only, this means you can write to memory now and persist it to disk later. This is fast. When you are reading, this means that page replacement has started, you do not have all data available in RAM and you have to read pages from disk just to update them and put

Re: Error when we shutdown the node during a rebalance

2019-12-10 Thread Ilya Kasnacheev
Hello! What walMode do you happen to use? Can you share your nodes' configurations? Regards, -- Ilya Kasnacheev ср, 4 дек. 2019 г. в 19:28, krkumar24061...@gmail.com < krkumar24061...@gmail.com>: > Hi - I am bumping into the following error frequently and causing the data > loss whenever we

Re: IgniteOutOfMemoryException in LOCAL cache mode with persistence enabled

2019-12-10 Thread Ilya Kasnacheev
Hello! 10M is very very low-ball for testing performance of disk, considering how Ignite's wal/checkpoints are structured. As already told, it does not even work properly. I recommend using 2G value instead. Just load enough data so that you can observe constant checkpoints. Regards, -- Ilya

Re: How sql works for near cache

2019-12-10 Thread Stanislav Lukyanov
Not out of the box but you could use SQL or ScanQuery for that. With SQL: SELECT _key FROM mycache (given that your cache is SQL-enabled). With ScanQuery: cache.query(new ScanQuery(), Cache.Entry::getKey) (may need to fix type errors to compile this) Stan On Wed, Dec 4, 2019 at 2:36 AM

Re: How sql works for near cache

2019-12-10 Thread Ilya Kasnacheev
Hello! You can use cache.localEntries(CachePeekMode.NEAR); Regards, -- Ilya Kasnacheev ср, 4 дек. 2019 г. в 02:36, Hemambara : > Is there any way we can get complete keyset or values from a near cache. > Something like cache.keyset() > > > > -- > Sent from:

Re: Alter table issue

2019-12-10 Thread Ilya Kasnacheev
Hello! I'm afraid the development of 3.0 have not started yet. Please avoid re-creating columns that were previously dropped. Instead, use new column name. Regards, -- Ilya Kasnacheev вт, 3 дек. 2019 г. в 15:51, Shravya Nethula < shravya.neth...@aline-consulting.com>: > Hi Ivan, > > Thank

Re: Cache data not being stored on server nodes

2019-12-10 Thread Ilya Kasnacheev
Hello! > When a put(key, value) call is made on the client would that put the data in one of the servers automatically if the cache is configured in PARTIONED mode Yes. Regards, -- Ilya Kasnacheev пн, 2 дек. 2019 г. в 22:40, swattal : > Hi Andrei, > > Thank you for the response. I do see

Re: Ignite hanging (dead looping) at TCP discovery stage

2019-12-10 Thread Ilya Kasnacheev
Hello! Is this the only node? I think it gets confused by connecting to an unfamilliar address and finding itself there. Maybe also it no longer sees its own address in its discovery. I recommend setting igniteCfg.localHost with a "right" address, possibly discoverySpi.localAddress too.

[no subject]

2019-12-10 Thread contact
Hi

Re: Ignite Hanging on startup after OOME

2019-12-10 Thread akurbanov
Hi Mitchell, What is the reproducer for the issue, is my assumption correct: no persistence, fill small data region with data, crash, restart? Are you hit with OutOfMemory or exactly IgniteOutOfMemory? Are you able to capture JVM thread dump in this case? Best regards, Anton -- Sent from:

Re: can't use ignite get() method with error logs

2019-12-10 Thread akurbanov
Hello, Could you please provide the full log for the case, the message seems to be cut. The perfect way would be to provide short reproducer for the thing that you are trying to do. The configuration itself is fine, there is nothing that may break the cluster. Best regards, Anton -- Sent

Re: Deadlock on concurrent calls to getAll and invokeAll on cache with read-through

2019-12-10 Thread peter108418
Thank you for looking into the issue, good to hear you were able to reproduce it. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: GridGain Web Console is available free of charge for Apache Ignite

2019-12-10 Thread Mikael
Hi! I guess you should forward that information to GridGain as web console is not part of Apache Ignite. Mikael Den 2019-12-10 kl. 13:10, skrev Prasad Bhalerao: Hi, We found 3 vulnerabilities while scanning Grid Gain Web console application. We are using HTTP and not HTTPS due to some

Re: Manage offset of KafkaStreamer

2019-12-10 Thread Andrei Aleksandrov
Hi, Generally you can't do it using Ignite KafkaStreamer API because it's not so flexible to configure the KafkaConsumer used inside. Generally it supported in

Re: GridGain Web Console is available free of charge for Apache Ignite

2019-12-10 Thread Prasad Bhalerao
Hi, We found 3 vulnerabilities while scanning Grid Gain Web console application. We are using HTTP and not HTTPS due to some issues on our side. Although vulnerabilities are of lower severity, but thought of reporting it here. 1) HTTP TRACE / TRACK Methods Enabled. (CVE-2004-2320

Re: GridGain Web Console is available free of charge for Apache Ignite

2019-12-10 Thread Denis Magda
It's free software without limitations. Just download and use it. - Denis On Tue, Dec 10, 2019 at 1:21 PM Prasad Bhalerao < prasadbhalerao1...@gmail.com> wrote: > Hi, > > Can apache ignite users use it for free in their production environments? > What license does it fall under? > > Thanks, >

ValueExtractor support in Apache Ignite

2019-12-10 Thread Rastogi, Arjit (CWM-NR)
Hi All, What is the Oracle Coherence ValueExtractor equivalent in Apache Ignite which can enable us to create dynamic indexes by extracting elements in a Map/ List inside POJO. Use case:

Re: GridGain Web Console is available free of charge for Apache Ignite

2019-12-10 Thread Prasad Bhalerao
Hi, Can apache ignite users use it for free in their production environments? What license does it fall under? Thanks, Prasad On Fri, Oct 4, 2019 at 5:33 AM Denis Magda wrote: > Igniters, > > There is good news. GridGain made its distribution of Web Console > completely free. It goes with

can't use ignite get() method with error logs

2019-12-10 Thread ???????-^
Hi: when i used ignite get() method in my java project to connect my ignite 2.7.6 on linux, it print logs ,and i cant use get(),logs like this: