Re: Statistics Monitoring Integrations

2018-08-13 Thread Co1l
You can collect statistics through remote JMX. Use IGNITE_JMX_PORT environment variable to set port. Seems like DataDog able to connect to remote Mbeans server. There are should be 3rd party plugins for NewRelic. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Possible issue with Web Console

2018-08-13 Thread Alexey Kuznetsov
Hi! Could you describe how you are starting Web Console? Also, from what DB you are importing tables? Could you attach a SQL script that we can try to reproduce? Import should work in open source Web Console. On Tue, Aug 14, 2018 at 2:01 AM sv wrote: > Web Console, Configure -> Import from

C++ client Exception occurred: Unexpected header during deserialization: 9

2018-08-13 Thread wengyao04
Hi we are using c++ client, our key and data are ignite BinaryType After we populate data, we try to use SqlQuery to get some data back however we get Exception occurred: Unexpected header during deserialization: 9 Does anyone have any clue for this exception ? Thanks -- Sent from:

C++ client Exception occurred: Unexpected header during deserialization: 9

2018-08-13 Thread wengyao04
Hi we are using c++ client, our key and data are ignite BinaryType After we populate data, we try to use SqlQuery to get some data back however we get Exception occurred: Unexpected header during deserialization: 9 Does anyone have any clue for this exception ? Thanks -- Sent from:

Re: Free Network Segmentation (aka split brain) plugin available

2018-08-13 Thread luqmanahmad
Thanks Dmitry. I have also added the initial version of TcpIpSegmentation - Still not sure about it but hopefully it should fill the purpose - So far I have tested it with postgres, sql server and tomcat -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Effect of WriteSynchronizationMode on write operations inside a transaction in Apache Ignite

2018-08-13 Thread Kia Rahmani
The main reason I want to add backups is to allow very fast reads (assuming backup reads are allowed). Do you know of any way of keeping (stale) copies locally (next to the clients) in order to save network latency in read operations, without affecting write latency? -- Sent from:

Re: Effect of WriteSynchronizationMode on write operations inside a transaction in Apache Ignite

2018-08-13 Thread Kia Rahmani
Thanks for the prompt reply! Here is my client code: https://www.codepile.net/pile/ywYXOvJX In the experiment, the client resides in Singapore and 2 servers are located at Singapore (same machine as the client) and Ohio. The primary copy is maintained at Ohio and the backup is kept in Singapore

Possible issue with Web Console

2018-08-13 Thread sv
Web Console, Configure -> Import from Database, select some tables, Download project: The downloaded .zip file does not contain any of the Model java classes for the tables, and the XML file does not contain any queryEntities definitions for any of the tables. When I click on "Project Structure"

Re: Effect of WriteSynchronizationMode on write operations inside a transaction in Apache Ignite

2018-08-13 Thread akurbanov
Hello, Can you share your benchmark? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: WebConsole does not see cluster

2018-08-13 Thread KJQ
So, I finally got this working. I ended up: - Copying the rest-http module into my main Ignite node (the only one who's IP i am using for discovery right now). - I shell into the running "ignite" instance and run the web agent from there (not outside the containers) Questions: - I see in

Effect of WriteSynchronizationMode on write operations inside a transaction in Apache Ignite

2018-08-13 Thread Kia Rahmani
Hi Folks, WriteSynchronizationMode allows users to pick from 3 different synchronization modes (FULL_SYNC, FULL_ASYNC, PRIMARY_SYNC) when performing writes on a distributed setting. Based on my understanding, when writing to the cache (whether inside or outside of a transaction) the

Map C# class to Cassandra persistence settings

2018-08-13 Thread crenique
Hello, I am integrating Cassandra to ignite.NET. I followed an example, and managed to make a cache be persisted to Cassandra with primitive data types. https://apacheignite-mix.readme.io/v2.6/docs/examples But is it possible to map C# key/value type classes to the Cassandra persistence

how ignite c++ node set baselinetopology

2018-08-13 Thread wangsan
I have a java node with persistence. Then when c++ node join.how to active and set blt with api? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: what are the alternative for IgniteQueue for FIFO transactional, reliable, low-latency messaging

2018-08-13 Thread dkarachentsev
Hi, I think the best way here would be to read items directly from kafka, process and store in cache and rememeber in another cache kafka stream offset. If node crashes, your service could start from the last point (offset). Thanks! -Dmitry -- Sent from:

Re: Transaction Throughput in Data Streamer

2018-08-13 Thread dkarachentsev
Hi, It looks like the most of the time transactions in receiver are waiting for locks. Any lock adds serialization for parallel code. And in your case I don't think it's possible to tune throughput with settings, because ten transactions could wait when one finish. You need to change algorithm.

Re: System cache's DataRegion size is configured to 40 MB.

2018-08-13 Thread dkarachentsev
Hi, Yes, you're right, it was missed during refactoring. I've created a ticket [1], you may fix it and contribute to Apache Ignite :) [1] https://issues.apache.org/jira/browse/IGNITE-9259 Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Spark to Ignite Data load, Ignite node crashashing

2018-08-13 Thread dkarachentsev
Hi, Looks like it was killed by kernel. Check logs for OOM Killer: grep -i 'killed process' /var/log/messages If process was killed by Linux, correct your config, you might be set too much memory for Ignite paged memory, set to lower values [1] If not, try to find in logs by PID, maybe it was

Re: No response from ignite job tracker

2018-08-13 Thread ilya.kasnacheev
Hello! You should not use curl to test 11211 port since it's not an HTTP port. I don't think that Ignite binary client protocol supports whatever mapreduce.jobtracker.address expects. Have you tried "local"? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite instance with provided name doesn't exist. Did you call Ignition.start(..) to start an Ignite instance?

2018-08-13 Thread Ilya Kasnacheev
Hello! You need to start a node in that process (client or server) to communicate with stand-alone node. You can only reference Ignite nodes in local Java process by name. Regards, -- Ilya Kasnacheev 2018-08-13 16:22 GMT+03:00 monstereo : > I have started Ignite node with >

Ignite instance with provided name doesn't exist. Did you call Ignition.start(..) to start an Ignite instance?

2018-08-13 Thread monstereo
I have started Ignite node with igniteConfiguration.setIgniteInstanceName("sample"); now,i want to get instance of this 'sample' node here is the main app(assume that sample is node is running) public static void main(String[] args) throws IgniteCheckedException {

Re: Free Network Segmentation (aka split brain) plugin available

2018-08-13 Thread dkarachentsev
Hi, Nice work, thank you! I'm sure it will be very useful. Looking forward for your contributions in Apache Ignite project ;) Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Partition distribution across nodes

2018-08-13 Thread dkarachentsev
Hi, Ignite by default uses Rendezvous hashing algorithm [1] and RendezvoudAffinityFunction is an implementation that responsible of partition distribution [2]. This allows significantly reduce traffic on partiton rebalancing. [1] https://en.wikipedia.org/wiki/Rendezvous_hashing [2]

Partition distribution across nodes

2018-08-13 Thread Prasad Bhalerao
Hi, How does ignite distribute partition across available nodes? E.g: if there are 4 nodes and 1024 partitions, then partition P1 goes to Node N1, P2 goes to N2 , P3 goes to N3 and P4 goes to N4 and so on. What algorithm does ignite use to distribute partitions? Thanks, Prasad

Re: security question - custom plugin

2018-08-13 Thread dkarachentsev
Hi, 1) You need to add jetbrains annotation in compile-time [1]. 2) Imports depend on what are you using :) It's hard to say if your imports enough. Add ignite-core to your plugin dependencies. I don't think that there are other examples besides that blog post. [1]

Re: While enabling JCache, JCacheMetrics is throwing NullPointerException in getCacheManager with spring boot

2018-08-13 Thread daya airody
Hi slava, I have uploaded my code at below link: https://github.com/daya-airody/ignite-caching You need uncomment below lines in application.properties before running startup.sh. spring.cache.jcache.config=classpath:example-cache.xml spring.cache.cache-names=users,cannedReports When you run

Re: values retrieved from the cache are wrapped with JdkDynamicAopProxy while using springboot and JCache

2018-08-13 Thread daya airody
HI Ivan, I have uploaded a simple spring application reproducing the issue at below link: https://github.com/daya-airody/ignite-caching When I use ConcurrentMapCache to cache results from spring JPA native query, I am able to retrieve it correctly. However, once I enable ignite and JCache, I

Re: When using CacheMode.LOCAL, OOM

2018-08-13 Thread dkarachentsev
Hi, I've opened a ticket for this [1]. It seems LOCAL cache keeps all entries on-heap. If you use only one node - switch to PARTITIONED, if more than one - PARTITIONED + node filter [2] [1] https://issues.apache.org/jira/browse/IGNITE-9257 [2]

Re: Running Spark Job in Background

2018-08-13 Thread Ilya Kasnacheev
Hello! You can invoke `disown' after launching process with &. Note that & and nohup are very different, it is very strange if the result is the same. Nohup jobs don't even use same terminal. Regards, -- Ilya Kasnacheev 2018-08-13 14:02 GMT+03:00 ApacheUser : > Thanks Denis, > > When Submit

Re: Running Spark Job in Background

2018-08-13 Thread ApacheUser
Thanks Denis, When Submit Spark job which connects to Ignite cluster creates an Ignite Client. The Ignite Client gets disconnected whe I close the window(Linux Shell). Regular Spark jobs are running fine with & or nohup, but in Spark/Ignite case, the clienst ae getting killed and spark job

Re: taking more time while reading records.

2018-08-13 Thread Denis Mekhanikov
Shuvendu, What is your cluster configuration? How many nodes do you have? Do you use persistence or 3rd party storage? How do you read data? Denis пн, 13 авг. 2018 г. в 7:43, Shuvendu Das : > Hi, > > We came across a situation where it is taking 10 time more time while > reading records. >

Re: Running Spark Job in Background

2018-08-13 Thread Denis Mekhanikov
This is not really an Ignite question. Try asking it on Spark userlist: http://apache-spark-user-list.1001560.n3.nabble.com/ Running commands with & is a valid approach though. You can also try using nohup . Denis вс, 12 авг. 2018 г. в 5:12, ApacheUser : >

Re: Failed to create index on cache

2018-08-13 Thread ilya.kasnacheev
Hello! I suggest specifying shorter index name manually, since it looks like automatically generated index name was too long (longer than 255 bytes). It has no relation to number of fields, just to its name which can be any compliant string. Regards, -- Sent from:

Re: Perfromance Issues when Grid size is more (.Net)

2018-08-13 Thread ilya.kasnacheev
Hello! I suggest you continue discussion in http://apache-ignite-users.70518.x6.nabble.com/Is-Cache-reads-take-long-time-with-cache-size-increase-td23326.html instead of starting new threads. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Any mbean call to get all deployed services in a grid

2018-08-13 Thread ilya.kasnacheev
Hello! I went through MBeans and MXBeans in Apache Ignite code base, found no such calls. Please feel free to contribute. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: ODBC Driver compile error

2018-08-13 Thread Linus Surguy
On 13/08/2018 09:37, Ilya Kasnacheev wrote: Hello Floris, Linus. We have a patch for OpenSSL 1.1 compatibility, but it's not in any released versions. Hi, Thanks all, reporting back for other people if they search the archive. I can confirm that this was indeed my problem and on Debian

security question - custom plugin

2018-08-13 Thread wt
I am looking at the http://smartkey.co.uk/development/securing-an-apache-ignite-cluster/ example but it doesn't dive into details and when trying to build one myself i am unsure of the following 1) what imports are needed for the annotations is it org.jetbrains.annotations? 2) i have the

Re: Performance degradation in embed mode

2018-08-13 Thread Ilya Kasnacheev
Hello! In your thread dump I observe that context creation is still underway (org.apache.catalina.mbeans.MBeanFactory.createStandardContext) No load is passed to Apache Ignite yet. Regards, -- Ilya Kasnacheev 2018-08-11 12:09 GMT+03:00 Dmitriy : > Hello Igniters, > > I'm using an spring web

Re: Apache Ignite as Hibernate L2 cache

2018-08-13 Thread Ilya Kasnacheev
Hello! There's an epic thread with a lot of examples: http://apache-ignite-users.70518.x6.nabble.com/Hibernate-L2-cache-with-Ignite-How-td22570.html The compatible versions, roughly, seem to be 4.2 and 5.1. Note that since Hibernate is LGPL, you will have to build Ignite modules on your side.

Re: ODBC Driver compile error

2018-08-13 Thread Ilya Kasnacheev
Hello Floris, Linus. We have a patch for OpenSSL 1.1 compatibility, but it's not in any released versions. Regards, -- Ilya Kasnacheev 2018-08-12 22:32 GMT+03:00 Floris Van Nee : > Hi Linus, > > I had the same error when I was trying to compile with openssl 1.1. > Compiling with openssl1.0

Failed to create index on cache

2018-08-13 Thread prem
Hi, create index sql query fails with javax.cache.CacheException: Schema change operation failed: Too long encoded indexName. is there a limit to number of columns we can index. Regards, Prem

Re: Node with BaselineTopology cannot join mixed clusterrunningincompatibility mode

2018-08-13 Thread Alex Plehanov
You can restart the cluster. Compatibility mode flag is not stored to PDS, it exists only in memory. 2018-08-13 9:06 GMT+03:00 arunkjn : > Thanks Alex, > > How can I fix this in the current cluster without resetting the persistence > state of entire cluster? > > > > -- > Sent from:

Re: SEVERE: Failed to resolve default logging config file: config/java.util.logging.properties

2018-08-13 Thread Evgenii Zhuravlev
It's a class loading problem for all-in-one jar again. In any case, you don't need includeEventTypes at all right now, so, just delete it. To avoid this problem you can just use your project jar separately and configure proper classpath with all needed jars 2018-08-13 10:53 GMT+03:00 monstereo :

Re: SEVERE: Failed to resolve default logging config file: config/java.util.logging.properties

2018-08-13 Thread monstereo
Does not work again. Maven is really interesting thing Here i the pom.xml, after your suggestion pom.xml Same error was given (Note that: there was no error when I convert to jar with one-jar plugin) -- Sent from:

Re: SEVERE: Failed to resolve default logging config file: config/java.util.logging.properties

2018-08-13 Thread Evgenii Zhuravlev
Why do you use other maven plugins? Then it's problem with dependencies again. Just use the assembly plugin and that's all: org.apache.maven.plugins maven-assembly-plugin 2.4.1 maven-assembly-plugin

Re: SEVERE: Failed to resolve default logging config file: config/java.util.logging.properties

2018-08-13 Thread monstereo
No it does not work. I am using intellji, I run the tools > xml action > validate, for pom.xml and config.xml, and intellji said 'No errors found' but same error exists. (note that: i have also tried to change the configuration xml with default configuration(and add just propery=gridLogger, but

Re: SEVERE: Failed to resolve default logging config file: config/java.util.logging.properties

2018-08-13 Thread Evgenii Zhuravlev
Well, you just broke xml, so it can't even be parsed. I sure you can fix it by using any XML validator - all IDEs have this built-in. 2018-08-13 10:06 GMT+03:00 monstereo : > I have tried with your suggestion, but this time there is an error like > this:(when I remove Property

Perfromance Issues when Grid size is more (.Net)

2018-08-13 Thread shuvendu
We came across a situation where it is taking 10 time more time while reading records. Our initial grid size is 390,746 (count) Grid size increased to 7,297,301 (count) Now it is taking 10 times more time. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: SEVERE: Failed to resolve default logging config file: config/java.util.logging.properties

2018-08-13 Thread monstereo
I have tried with your suggestion, but this time there is an error like this:(when I remove Property 'includeEventTypes from xml configuration, it works FINE!!) Here is the pom.xml Caused by:

Re: Node with BaselineTopology cannot join mixed clusterrunningincompatibility mode

2018-08-13 Thread arunkjn
Thanks Alex, How can I fix this in the current cluster without resetting the persistence state of entire cluster? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Node with BaselineTopology cannot join mixed clusterrunningincompatibility mode

2018-08-13 Thread arunkjn
Hi, I am experiencing the same issue with a ignite 2.5 cluster deployed in kubernetes. Scenario: 5 server nodes hosting some caches. They are deployed multiple times without issues. I connected a visor client to this cluster (this is the first time i used visor ever on this cluster) On another