ignite stops expiring caches after a period of time

2018-12-20 Thread scottmf
hi,I'm having trouble with cache expiry. We are trying to expire a cache every minute and it works for some time then it seems to stop expiring the cached objects. I'm trying it with eagerTtl = true & false. Here is my cacheConfiguration and IgniteConfiguration: CacheConfiguration

Re: deep learning over apache ignite

2018-12-20 Thread Mehdi Seydali
My dear friend. I have a glance on tensorflow on ignite. I have the same idea as you but only one thing is added. In addition distributing job to local data, i will use gpu in addition to cpu core. Are you agree with total idea? Is there anything for debating? On Wednesday, December 19, 2018,

how credentials can be provided in client side when ignite authentication is enabled

2018-12-20 Thread radha jai
Hi, I have started the ignite servers by enabling ignite authentication, so ignite is creating username and password. I want to know how to pass the username and password in the client configuration file(.xml), so that it talks to server. Regards radha

Re: unable to access ignite through ingress endpoints on k8s

2018-12-20 Thread radha jai
It was a mistake in my ingress side. I am able to access the ignite rest endpoint through ingress endpoints. Regards radha On Wed, 19 Dec 2018 at 10:43, radha wrote: > Hi, >Inorder to access the ignite rest port from outside, i am using > kubernetes ingress. > > ignite-ingress.yaml: >

Re: Ignite we-console security

2018-12-20 Thread Shesha Nanda
Hi Alexey, Currently am trying on Dev mode "npm start" in console. Once am able to configure SSL on console, Then I ll try it on Docker. Do you have any links/steps to manually configure Nginx to handle SSL. On Fri, Dec 21, 2018 at 8:30 AM Alexey Kuznetsov wrote: > Hi, Sheshananda! > > So,

Re: Ignite we-console security

2018-12-20 Thread Alexey Kuznetsov
Hi, Sheshananda! So, you are running Web Console in Dev mode? "npm start" in console? or You are building Docker images? Any way it seems that you need to wait IGNITE-9845 and IGNITE-10668 Both of mentioned ticked will be merged to master in a couple of days. Or you can manually configure Nginx

Re: Ignite we-console security

2018-12-20 Thread Shesha Nanda
Hi Alexey, I have cloned *apache-ignite-2.7.0* source code and following below link to build. https://github.com/apache/ignite/blob/ignite-2.7/modules/web-console/DEVNOTES.txt On Wed, Dec 19, 2018 at 12:59 PM Alexey Kuznetsov wrote: > Hi, Sheshananda! > > How are you starting Ignite Web

Re: Ignite in container enviroments?

2018-12-20 Thread javadevmtl
Ok I think I have possible solution... Based on: https://docs.mesosphere.com/1.11/networking/DNS/ The container IP is available at: .marathon.containerip.dcos.thisdcos.directory also according to the docs this will return the proper I.P if in container or bridge mode. Currently I only have

Re: Re: Partition-exchanger blocked after upgrade to 2.7

2018-12-20 Thread Loredana Radulescu Ivanoff
Hello, We've been witnessing a similar set of logs from Apache Ignite after upgrading to 2.7 (from 2.6) in a couple of different environments, one of which had only one Ignite node. Very frequently, ignite will log the message "Blocked system-critical thread has been detected. This can lead to

Re: Ignite .NET in docker (linux)?

2018-12-20 Thread Pavel Tupitsyn
1. Yes, Ignite.NET will run in Linux docker container under .NET Core. You can use microsoft/dotnet:sdk base image, install Java there (apt install default-jdk), and run your app 2. There are no Windows containers with Ignite Thanks, Pavel On Thu, Dec 20, 2018 at 4:07 PM Ilya Kasnacheev wrote:

Re: Ignite in container enviroments?

2018-12-20 Thread javadevmtl
Maybe allow amore general SPI that scans I.Ps based on wildcard. For example: 9.x.x.*? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Re: Partition-exchanger blocked after upgrade to 2.7

2018-12-20 Thread ilya.kasnacheev
Hello! Do you have any non-standard settings for failureDetectionTimeout or networkTimeout? Do you have any observable issues besides occasional extra logging? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite in container enviroments?

2018-12-20 Thread javadevmtl
Hi, on that note I will try the mesos framework. And a native IPFinder DC/OS would be appreciated (not swarm). >From what I see some Hazelcast folks have done something similar... This uses marathon: https://github.com/phaneesh/hazelcast-marathon-discovery This seems to just use the container

Re: org.springframework.beans.NotWritablePropertyException: Invalid property 'awsCredentialsProvider' of bean class [org.apache.ignite.spi.discovery.tcp.ipfinder.s3.TcpDiscoveryS3IpFinder]

2018-12-20 Thread Ilya Kasnacheev
Hello! Can you show complete exception with stack traces? Regards, -- Ilya Kasnacheev пт, 14 дек. 2018 г. в 03:16, Max Barrios : > I have a Spark 2.2.0 app that writes a RDD to Ignite 2.6.0. It *works* in > local Spark (2.2.0) mode, accessing a remote Ignite 2.6.0 cluster, > > In my

Re: Failed to map keys for cache (all partition nodes left the grid)

2018-12-20 Thread kvenkatramtreddy
Hi, I want to receive the data even on one node. Can I add any set of commands so that it can copy all partitions to active nodes when node left (OR) Can I make it is cache mode replicated and will it work? Thanks & Regards, Venkat -- Sent from:

RE: adding into baseline topology

2018-12-20 Thread Stanislav Lukyanov
Hi, Can you show the logs? Thanks, Stan From: Som Som Sent: 20 декабря 2018 г. 12:08 To: user@ignite.apache.org Subject: adding into baseline topology i am trying to add node into baseline topology:  using (var ignite = Ignition.StartFromApplicationConfiguration())             {    

Re: Ignite in container enviroments?

2018-12-20 Thread Stephen Darlington
I guess we should update the documentation. Does this suggest that an IpFinder for Docker Swarm (much like the one for Kubernetes) would be useful? Regards, Stephen > On 20 Dec 2018, at 14:13, Ilya Kasnacheev wrote: > > Hello! > > #1 you should use

Re: Failed to map keys for cache (all partition nodes left the grid)

2018-12-20 Thread akurbanov
Hi, That means that for a given partition to which given key is mapped, both primary and backup partition nodes are offline. This cache ('users') persistent and you are getting this exception when you have only one node from baseline online. You have to get back both nodes online and call

Re: Ignite in container enviroments?

2018-12-20 Thread Ilya Kasnacheev
Hello! #1 you should use ./libs/optional/ignite-mesos/ignite-mesos-.jar - looks like it's THE full JAR. Regards, -- Ilya Kasnacheev чт, 20 дек. 2018 г. в 02:09, javadevmtl : > Hi, from what I have tried and read it seems that you need host network for > docker to run Ignite and overlay

Re: Do we require to set MaxDirectMemorySize JVM parameter?

2018-12-20 Thread colinc
Is there any alternative way to constrain max physical RAM that Ignite uses? My use case is to constrain physical RAM usage in a shared environment, while allowing a relatively generous allocation of swap storage. I'm aware of Ignite persistence, but believe that swap storage might meet our needs

Re: Java Thin Client support to deploy services on a cluster

2018-12-20 Thread Denis Mekhanikov
Zaheer, Currently thin client doesn't support service-related operations. Regular client or server node should be used for service deployment. Denis чт, 20 дек. 2018 г. в 11:03, Zaheer : > Hi, > > I saw from documentation about Thin clients used to create, destroy caches. > I wanted to know if

Re: Optimizing Collocated Join

2018-12-20 Thread Ilya Kasnacheev
Hello! As I have already said, there is likely a problem with index selectivity. SQL engine has to walk every record where coveringId = 166, and it has to do join for every such record by using index on parentS2CellId, and only then it can filter by date. Regards, -- Ilya Kasnacheev ср, 19

Re: Ignite .NET in docker (linux)?

2018-12-20 Thread Ilya Kasnacheev
Hello! For the first question: There's no reason that you would not be able to run Java, Mono or dotnet core Ignite node inside docket, connect to it with C# client. Should be working as soon as you configure it properly. Regards, -- Ilya Kasnacheev чт, 20 дек. 2018 г. в 12:36, F.D. : > Hi

Re: Dealing with changing class definitions in Ignite

2018-12-20 Thread Gert Dubois
For now we can work around the issue by overriding the BinaryNameMarshaller and ensuring our clients append a unique identifier behind the class name. This ensures that every client gets their own Binary Metadata records in the Marshaller for every class they serialize in the cluster.

Re: How Ignite transfer cached data between nodes in the cluster

2018-12-20 Thread Павлухин Иван
Hi, Actually, all code paths are not trivial. If you would like to dig into data retrieval process for IgniteCache.get you can explore GridPartitionedSingleGetFuture and check where GridNearSingleGetRequest is created and how is it handled. ср, 19 дек. 2018 г. в 18:26, vyhc...@hotmail.com : > > I

Re: External multiple config files for Docker installation

2018-12-20 Thread akurbanov
Hi, You can use to include some configuration properties, that is a generic way to do this. As for Jetty config, you should point to absolute or relative to $IGNITE_HOME path: Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Question about cpu usage and disk read speed on activation stage.

2018-12-20 Thread aealexsandrov
Hi, I was wrong. You can activate the cluster with not full baseline topology. Looks like you that your node that stopped during checkpoint and it is a reason of long recovery of the binary memory that takes a lot of time. Here is a ticket that should optimize this process:

Re: Question about cpu usage and disk read speed on activation stage.

2018-12-20 Thread aealexsandrov
Hi, I see from your log that you have two nodes in your baseline: [23:36:58,866][INFO][main][GridDiscoveryManager] ^-- Node [id=B3234010-F5BE-49CA-A57F-6676622BFF48, clusterState=INACTIVE] [23:36:58,867][INFO][main][GridDiscoveryManager] ^-- Baseline [id=2, size=2, online=1, offline=1]

Ignite .NET in docker (linux)?

2018-12-20 Thread F.D.
Hi Igniters, I'd like to know if is it possible to use ignite docker (with linux O.S.) and connect a ignite client in C#. I suppose no, is it? So the second question, is already present in the docker repository an image for Ignite .NET (with windows O.S.)? Thanks, F.D.

adding into baseline topology

2018-12-20 Thread Som Som
i am trying to add node into baseline topology: using (var ignite = Ignition.StartFromApplicationConfiguration()) { var baselineTopology = ignite.GetCluster().GetBaselineTopology(); var node = ignite.GetCluster().GetNode(Guid.Parse(

External multiple config files for Docker installation

2018-12-20 Thread kyro
Hi, Is there any way to provide multiple config files while running ignite from the docker image? In the docs it is mentioned that we can provide the path to one config.xml file. I was wondering if there is any way to provide multiple config files, such as a jetty config xml file along with that.

Java Thin Client support to deploy services on a cluster

2018-12-20 Thread Zaheer
Hi, I saw from documentation about Thin clients used to create, destroy caches. I wanted to know if there is any way to deploy services on my cluster through thin client. (Service implementation already placed in libs). I went through Javadoc of Ignite Client and found no method related to