Re: zombie ignite node

2018-08-06 Thread Prem Prakash Sharma
Can you check topology in ignite visor console. If you can find the zombie node there you can kill using kill command in visor. Regards, Prem > On 07-Aug-2018, at 11:01 AM, arunkjn wrote: > > Him > > It only shows one process each time which is 'grep ignite' the one I am > running. It does

Re: The Apache Ignite book - I have some confusion when reading?

2018-08-06 Thread monstereo
you have answered my all questions, thanks... -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

IgniteRepository Custom Config

2018-08-06 Thread Jack Lever
Hi All, Can any tell me if there's a way to change the atomicity mode from ATOMIC to TRANSACTIONAL and set the cache mode to REPLICATED for a cache created with the @IgniteRepository annotation? Or otherwise generally configure a cache started with the IgnRepo annotation? Thanks, Jack.

Re: zombie ignite node

2018-08-06 Thread arunkjn
Him It only shows one process each time which is 'grep ignite' the one I am running. It does not list any other ignite process. I have tried this before as well. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: zombie ignite node

2018-08-06 Thread Sambhaji Sawant
ps -aef |grep Ignite Use this command and kill Ignite process On Tue, Aug 7, 2018, 10:39 AM arunkjn wrote: > Thanks for the suggestion srecon. I will try that out. > > But is there any way I can find out and kill that ignite node? I have tried > deleting the configured wal and persistance

Re: zombie ignite node

2018-08-06 Thread arunkjn
Thanks for the suggestion srecon. I will try that out. But is there any way I can find out and kill that ignite node? I have tried deleting the configured wal and persistance directories. Tried JPS to list all java processes but could not find any. Even rebooted my system but the zombie node

Failed to add node to topology because it has the same hash code for partitioned affinity as one of existing nodes

2018-08-06 Thread kvenkatramtreddy
Hi Team, I have configured my all caches replicated mode with native persistence enable and running it on 3 nodes. 2 nodes runs on same server and another node run on different server. I have configured unique consistentId for each node and unique IGNITE_HOME. I also configured

Slides of Ignite use cases

2018-08-06 Thread Lijun Cao
Hi, I want to view some slides of ignite uses cases but I found that the slides’ link in Proven Use Cases for Apache Ignite™(https://ignite.apache.org/provenusecases.html ) page is not avaliable. How can I get the slides ? Regards, BOT

Re: what are the tehcniques to automatically detect changes in Multiple DBs and automatically push them into Ignite Cache

2018-08-06 Thread Juan Rodríguez Hortalá
That looks like something you could do with Kafka connect https://www.confluent.io/product/connectors/ using the jdbc source and the ignite sink. Just my 2 cents On Mon, Aug 6, 2018, 07:19 Deepa Kolwalkar wrote: > Thanks Prasad for your suggestions. > > The Legacy sytems are on different

Public thread pool starvation detected

2018-08-06 Thread boomi
Hello, We are having a possible deadlock issue with Apache Ignite .NET 2.5.0. We have setup a cluster with 5-server nodes and 1-client node. We try to execute ICompute action from the client node. And we see in one server node log, there was single line in the log file, indicates that some

Re: While enabling JCache, JCacheMetrics is throwing NullPointerException in getCacheManager with spring boot

2018-08-06 Thread Вячеслав Коптилин
Hello, > org.apache.ignite.cache.CacheExistsException: Failed to start cache (a cache with the same name is already started): users This exception means that the cache is already created in the cluster. Please consider using Ignite#getOrCreateCache() method instead of Ignite#createCache() [1]

Re: Ignite.NET how to cancel tasks

2018-08-06 Thread Вячеслав Коптилин
Hi Max, > using (var ignite = Ignition.Start()) Is it possible that Ignite node was closed before the cancellation request was processed by an instance of SimpleJob? Could you please check that fact? Perhaps you need to modify your code as follows: var task = ignite.GetCompute().ExecuteAsync(new

Re: The Apache Ignite book - I have some confusion when reading?

2018-08-06 Thread srecon
monstereo wrote > last question is-> in replicated mode all nodes are primary node? > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ Theoretically, In a replicated mode, each node stores one copy of the same cache. In terms of implementation, one single node responsible for

Re: zombie ignite node

2018-08-06 Thread srecon
Hi, To avoid this situation, the easiest way to configure static IP instead of TcpDiscoveryMulticastIpFinder. Use *TcpDiscoveryVmIpFinder* and write down all the IP address and ports to which you are going to connect. These particular configuration helps you to protect from the ghost nodes in a

Re: Not getting the column access in Ignite Cache created and loaded from Oracle

2018-08-06 Thread slava.koptilin
Hello, It seems that your question is already answered on SO https://stackoverflow.com/questions/51232522/not-getting-the-column-access-in-ignite-cache-created-and-loaded-from-oracle Long story short, you need to properly specify queryable entities. It can be done via QueryEntities or

zombie ignite node

2018-08-06 Thread arunkjn
Hi, I am using ignite 2.5.0 in local development. When I start a server node in my code, in the logs I can see that 2 server nodes are present in cluster. [22:10:46] Topology snapshot [ver=80, servers=2, clients=0, CPUs=8, offheap=4.6GB, heap=4.0GB] [22:10:46] ^-- Node

Re: Need help for setting offheap memory

2018-08-06 Thread Amol Zambare
Hi Alex, Here is the full stack trace [INFO][tcp-disco-sock-reader-#130][TcpDiscoverySpi] Finished serving remote node connection [INFO][tcp-disco-sock-reader-#653][TcpDiscoverySpi] Started serving remote node connection [SEVERE][tcp-disco-sock-reader-#130][TcpDiscoverySpi] Runtime error caught

Re: While enabling JCache, JCacheMetrics is throwing NullPointerException in getCacheManager with spring boot

2018-08-06 Thread daya airody
There is a problem with using spring.cache.cache-names=users,cannedReports When the SpringBoot application is restarted, it will throw below error: Caused by: org.apache.ignite.cache.CacheExistsException: Failed to start cache (a cache with the same name is already started): users at

Re: SqlFieldsQuery Cannot create inner bean 'org.apache.ignite.cache.query.SqlFieldsQuery

2018-08-06 Thread ApacheUser
Hello Ilya Kasnacheev, using Ignite 2.6. SQL through Tableau using ODBC connection is getting OOME when selct 8 from table without limit. I have set export IGNITE_SQL_FORCE_LAZY_RESULT_SET=true in ignite.sh. What else should I configure to avoid OOME when using ODBC? thanks -- Sent from:

Re: No response from ignite job tracker

2018-08-06 Thread engrdean
I can see messages in the ignite logs when I run my mapreduce job: [2018-08-06 10:15:56,914][WARN ][pub-#23817][HadoopJobTracker] ignite.job.shared.classloader job property is set to true; please disable it if job tasks rely on mutable static state. [2018-08-06 10:15:58,303][INFO

MySQL cache load causes java.sql.SQLException: GC overhead limit exceeded

2018-08-06 Thread Orel Weinstock (ExposeBox)
Hi all, Changing the MAIN_CLASS env variable and tweaking the default heap size (2.7GB) and default data region size (8GB), I'm trying to load a small (<4GB) MySQL table into the cache and get a GC overhead limit error. Should I increase memory? Is there a configuration I'm missing? Thanks, --

Re: OOM on connecting to Ignite via JDBC

2018-08-06 Thread Orel Weinstock (ExposeBox)
This is the correct port - I've set it manually. I've used the same configuration with the web console for inserting SQL rows and it works great with write-through. On 6 August 2018 at 16:30, Павлухин Иван wrote: > Hi Orel, > > Are you sure that correct port is used? By default 10800 port is

Re: While enabling JCache, JCacheMetrics is throwing NullPointerException in getCacheManager with spring boot

2018-08-06 Thread daya airody
I had to remove all the caches from ignite config file: This ensures that none of the caches loaded by JCache are created using ignite API. If I programmatically create cache and then add items to those caches, I don't get JCacheMetrics error.

Re: S3 discovery and bridge networks

2018-08-06 Thread Ilya Kasnacheev
Hello! Have you tried to specify localAddress for communication and discovery SPIs? If not, can you please elaborate with ifconfig information and stuff? Regards, -- Ilya Kasnacheev 2018-08-03 16:53 GMT+03:00 Dave Harvey : > I've been successfully running 2.5 on AWS ECS with host or AWSVPC >

Re: Errors with TCPCommunicationSpi when using zookeeper discovery

2018-08-06 Thread ilya.kasnacheev
Hello! I can imagine circumstances where clients will open connections to other clients, such as starting caches on clients or deploying services on clients. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Can't connect client to server after client shuts down the first time

2018-08-06 Thread Ilya Kasnacheev
Hello! Please make sure you're not reusing IgniteConfiguration object with its SPI objects. Some of those are not reusable, once used in a node they should not be used to start a new one. Regards, -- Ilya Kasnacheev 2018-07-31 3:41 GMT+03:00 ianhamilton_modelshop : > Hello, > > I'm doing a

Re: OOM on connecting to Ignite via JDBC

2018-08-06 Thread Павлухин Иван
Hi Orel, Are you sure that correct port is used? By default 10800 port is used for JDBC connections. You have 8080 in your command line. The error could be caused by reading unexpected input from server and interpreting it as very huge packet size. Attempt to allocate buffer of such size could

Re: what are the tehcniques to automatically detect changes in Multiple DBs and automatically push them into Ignite Cache

2018-08-06 Thread Deepa Kolwalkar
Thanks Prasad for your suggestions. The Legacy sytems are on different platforms and some of them are products .. so there is no way of implementing any custom logic in such products to send update messages. The Legacy Systems remain a black-box to us with only its DB which is accessible for

While enabling JCache, JCacheMetrics is throwing NullPointerException in getCacheManager with spring boot

2018-08-06 Thread daya airody
I am using ignite within a spring application using JCache API. Application is throwing NPE when starting up. -- exception Caused by: java.lang.NullPointerException: null at io.micrometer.core.instrument.binder.cache.JCacheMetrics.(JCacheMetrics.java:80) Spring is loading ignite

Re: Need help for setting offheap memory

2018-08-06 Thread Denis Mekhanikov
Amol, Data is pulled onto heap every time you use it. So, if your Spark jobs operate over big amount of data, then heap memory utilization will be high. Take a heap dump next time you encounter OutOfMemoryError. You can make Java take a heap dump every time it fails with OOME:

Re: Ignite memory leak

2018-08-06 Thread Denis Mekhanikov
Igor, There really is a memory leak in this place. Thank you for the analysis! This is very cool! I filed a JIRA ticket for it: https://issues.apache.org/jira/browse/IGNITE-9196 Feel free to assign it to yourself and fix it, since you already debugged through it. If not, then I think, it will be

RE: Service not found for a deployed service

2018-08-06 Thread Calvin KL Wong, CLSA
Hi Denis, >> Did Service#init() method throw any exceptions? No, we didn’t see any exception. I will get a stack trace if I can reproduce it. Thanks, Calvin From: Denis Mekhanikov [mailto:dmekhani...@gmail.com] Sent: Friday, August 03, 2018 8:08 PM To: user@ignite.apache.org Subject: Re:

Re: what are the tehcniques to automatically detect changes in Multiple DBs and automatically push them into Ignite Cache

2018-08-06 Thread Prasad Bhalerao
Can this back office legacy system send you a DB update message or can you make this back office system to send you DB update message? If yes then you can have the Id/primary key, DB operation and table name in this DB update message. In your application you use this information to refresh your

Re: what are the tehcniques to automatically detect changes in Multiple DBs and automatically push them into Ignite Cache

2018-08-06 Thread Deepa Kolwalkar
Thanks Denis. But as I mentioned in earlier mail, the Caches are meant to be Read-Only (only to be used by Microservices for fetching data). The Databases are updated by backoffice legacy systems. Hence we cannot do a Write-through to the DBs via the CacheStore API. If anyone has used the

Re: No driver found in deployed docker image

2018-08-06 Thread Orel Weinstock (ExposeBox)
If anybody stumbles onto this - adding the mysql jdbc connector as a dependency in the generated pom.xml works. Just go to maven to get the exact XML for it. for example, mine is: * mysql mysql-connector-java 8.0.12 * On 6 August 2018 at 10:02, Orel Weinstock (ExposeBox) wrote: > Hi all, > >

Re: OOM on connecting to Ignite via JDBC

2018-08-06 Thread Orel Weinstock (ExposeBox)
I've followed the guide on setting up DBeaver to work with Ignite - I've set up a driver in DBeaver by selecting a class from the ignite-core jar, both version 2.6.0 My cluster is up and running now (e.g. write-through works) that I've added the MySQL JDBC driver to the (web-console generated)

Re: OOM on connecting to Ignite via JDBC

2018-08-06 Thread Denis Mekhanikov
Orel, JDBC driver fails on handshake for some reason. It fails with OOM when trying to allocate a byte array for the handshake message. But there is not much data transferred in it. Most probably, message size is read improperly. Do you use matching versions of JDBC driver and Ignite nodes?

Re: No response from ignite job tracker

2018-08-06 Thread Evgenii Zhuravlev
Hi, Are you sure that these requests reach the server? Do you have anything suspicious in Ignite logs? I'd recommend to check them at first. Evgenii 2018-08-03 23:42 GMT+03:00 engrdean : > I am successfully running mapreduce jobs using Ignite but I haven't been > able > to use the Ignite job

Re: Ignite Spring Data 2.0 not working with Spring Boot 2

2018-08-06 Thread Lokesh Sharma
I just realized that the problem wasn't with logging but rather the annotations like "PostConstruct" and "Scheduled" are not working with Ignite Spring Data_2.0. I've created an issue here https://issues.apache.org/jira/browse/IGNITE-9187 On Fri, Aug 3, 2018 at 11:03 AM Lokesh Sharma wrote: >

Re: what are the tehcniques to automatically detect changes in Multiple DBs and automatically push them into Ignite Cache

2018-08-06 Thread Denis Mekhanikov
There is no such feature in Ignite. If you know, how to subscribe for events in the external database, then you can implement this logic yourself. You just need to perform put into Ignite cache for every insert into the external DB. But the recommended way to do it is to perform writing on

No driver found in deployed docker image

2018-08-06 Thread Orel Weinstock (ExposeBox)
Hi all, I've set up a single node cluster using the docker image from the web console. I've set the correct property values in secret properties, and see that Ignite has the table metadata that I've imported from MySQL in the queries sidebar. I understand that I need to have data pre-loaded in

Re: How to do rolling updates with embedded Ignite and changing models

2018-08-06 Thread Roger Janssen
Using the BinaryObject API, which is used out-of-the-box by Ignite, we get this exception that I am trying to solve. We just want a simple in-memory cache, so I am not sure why I would use a heavy Ignite implementation as an inmem DB with SQL. That is overkill. And... why would that solve the