Re: Ignite we-console security

Hi, Sheshananda! How are you starting Ignite Web console? Docker? Direct install? Build from sources? On Wed, Dec 19, 2018 at 2:17 PM Shesha Nanda wrote: > Hi, > > Could you please let me know the steps to configure SSL security for the > Ignite web-console. > > -- > *Regards* > > *Sheshananda

RE: 200K records/sec

Hello. Ignite is distributed system, so it depends how much servers you use. It is also important, which transaction mode you use and contention frequency. I.e. In case of pessimistic serializable mode and one entry used in all transactions performance will poor. Entry size is very

Ignite we-console security

Hi, Could you please let me know the steps to configure SSL security for the Ignite web-console. -- *Regards* *Sheshananda *

200K records/sec

Is it possible to process 200K records/sec? All records should process in sequence. Each record will do the following: Cache 1 – Select Cache 2 – Select Cache 3 – Insert Cache 4 – Select and Update Cache 5 – Select and Merge Cache 6 – Select and Merge Cache 7 – Select and Insert or Delete

Re: How to benchmark IgniteDataStreamer?

Hello, IgniteDataStreamer is async, so how will you find the exact time? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Did anyone write custom Affinity function?

Yeah, we were planning to increase group IDs. Did anybody write custom Affinity function? If it is already written that will be helpful to us. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: deep learning over apache ignite

My dear friend. Our essential goals are just as below: 1. Distributed training for training model 2. Utilize Gpu in addition to Cpu for accelerate execution. In tensorflow do you implement two above mentioned? How much speed up do you gain relative to pure tensorflow? On Tuesday, December 18,

unable to access ignite through ingress endpoints on k8s

Hi, Inorder to access the ignite rest port from outside, i am using kubernetes ingress. ignite-ingress.yaml: === apiVersion: extensions/v1beta1 kind: Ingress metadata: name: test-ign-ignite annotations: ingress.kubernetes.io/ingress.class: nginx

Question about cpu usage and disk read speed on activation stage.

Hello. Ignite takes about 1 hour to activate on my machine.I have only one node and use version 2.6.I also enable persistence and use 22GB heap memory and 22GB off-heap memory.My machine has 16 cores.The cpu usage is very low(<%1) and the disk read speed is about 1M/s~6M/s while ignite is

Re: web console

Hi, Skollur. I just checked that web agent works fine under Oracle & Open JDK 8. It seems that you have some problems in your environment. Please check that you have correct java installed. And attach exact output from web agent console. On Wed, Dec 19, 2018 at 2:35 AM Skollur wrote: > I am

Re: Dealing with changing class definitions in Ignite

Hey Ilya, I opened a ticket on the ignite Jira about it. https://issues.apache.org/jira/browse/IGNITE-10717 I attached a zip file containing a maven project with sample code that reproduces our issue. Reproducing the issue is rather easy though 1. Have a client + server, with peer class loading

Scoped vs Singleton ignite client node in .net web api

I am try planning to introduce Apache Ignite into existing old .net web api project to use it as key/value store for detecting duplicate requests sent to the load balanced api. I would like to introduce minimum overhead to each request. As I understand Client node is communicating to the server

Re: Optimizing Collocated Join

Try this: SELECT subQuery.coveringId, COUNT(*) FROM ( SELECT innerS2.* FROM S2CellCovering AS innerS2 INNER JOIN EventTheta AS innerEvent ON innerEvent.parentS2CellId = innerS2.parentS2CellId AND innerEvent.s2CellId BETWEEN

web console

I am trying to ocnnect web console and downloaded ignite-web-agent-2.7.1. It doesnt seems to support java 1.8 and getting an error "jdk1.8.0_171 was unexpected at this time." What is the java version supported for ignite-web-agent-2.7.1? -- Sent from:

Re: Optimizing Collocated Join

Hi, I'm not sure how I could make this more efficient. I'm already joining on every column in the key. If I try to change the ordering so that EVENTDATE and EVENTHOUR precede the affinity key (PARENTS2CELLID), then the query optimizer selects only the affinity key for the join. It seems like

RE: Settings to override default Ignite JDBC Thin Driver port 10800

Thanks Ilya.. Regards, Sriveena From: Ilya Kasnacheev [mailto:ilya.kasnach...@gmail.com] Sent: Tuesday, December 18, 2018 9:56 PM To: user@ignite.apache.org Subject: Re: Settings to override default Ignite JDBC Thin Driver port 10800 Hello! As far as my understanding goes, you can have client

Re: Settings to override default Ignite JDBC Thin Driver port 10800

Hello! As far as my understanding goes, you can have client connectors on both client and server nodes, so it is up to you to decide which nodes you will be using as endpoints for thin clients. Regards, -- Ilya Kasnacheev вт, 18 дек. 2018 г. в 17:06, Sriveena Mattaparthi <

Re: deep learning over apache ignite

Do you have any recommendation about this idea?is it possible develope this idea and compare with tensoflow over ignite ? On Tuesday, December 18, 2018, dmitrievanthony wrote: > Hello, > > It's a good idea, machine learning in Apache Ignite is actively developing > right now and new features

Re: Ignite client node connect to visor

No,the visor is not work just as server or client. It is only cluster monitoring. On Tuesday, December 18, 2018, ashishb008 wrote: > Hello, > > Suppose we have a active cluster of 5 nodes, and some partitioned caches on > the cluster. And if I started the visor, will it add an extra node

Re: deep learning over apache ignite

Our,s goal are two things: 1. Acceleration of running deep neural network on two framework simultaneously ( ignite and spark) 2. Study that developing deep model with dl4j over ignite has better performance and speed up relared to dl4j? On Tuesday, December 18, 2018, zaleslaw wrote: > No,

Re: deep learning over apache ignite

No, currently we doesn't work on integration bw DL4j and Ignite The first step can be getting data from IgniteCache and wrapping to tensor and putting to local instance of DL4j. But currently I could help with code review only not with the example building. First of all, we should understand

Re: Ignite client node connect to visor

Hello, Suppose we have a active cluster of 5 nodes, and some partitioned caches on the cluster. And if I started the visor, will it add an extra node (server) to existing cluster? Thanks -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: deep learning over apache ignite

I am in first step and i have not succeeded to integrate dl4j with apache ignite. Is it possible for you how could you integrate them? On Tuesday, December 18, 2018, Mehdi Seydali wrote: > In a nutshell you want to say that this is a not good idea and may not > reach a good performancs? You

Re: deep learning over apache ignite

In a nutshell you want to say that this is a not good idea and may not reach a good performancs? You have integrated dl4j with apache ignite too? On Tuesday, December 18, 2018, zaleslaw wrote: > Hi, I'm a contributor of Ignite ML too and I'd like dl4j library too and > have > experience with

Re: Did anyone write custom Affinity function?

Hi! 3 different affinity keys on 3 nodes is not enough, it's a hash code that is used so you may end up with 2 groups (or even all 3) on one node, if you need it to work that way you will need to create your own affinity function. Any way you might be able to increase the number of group

Re: Ignite in docker (Native Persistence)

This is the ECS task we use to create the container. Caveat: we have a custom docker image with some enhancements to run.sh. Especially around consistent ID and what we call Autobaseline, and support for AWS instance storage (Ignite persistence is useless for us with EBS/GP2). I'll generate a

Re: Did anyone write custom Affinity function?

Hello, As of now, we have 3 nodes. We use group ID as affinity key, and we have 3 group IDs (1, 2 and 3). And we limit cache partitions to group IDs. Overall nodes=group IDs=cache partitions. So that each node have equal number of partitions. But it doesn't distribute cache partitions across the

Re: Ignite in docker (Native Persistence)

See attached, which we use in our AWS ECS containers. Note that beside WAL and data, the work directory needs persistence, because it has all the typeID mappings. On Tue, Dec 18, 2018 at 7:32 AM Павлухин Иван wrote: > Hi Rahul, > > Could you please share an ignite configuration and how do you

Re: Settings to override default Ignite JDBC Thin Driver port 10800

Thanks Ilya.. Are the client node changes mentioned below during start up not required then?please confirm Regards, Sriveena From: Ilya Kasnacheev Sent: 18 December 2018 19:22:45 To: user@ignite.apache.org Subject: Re: Settings to override default Ignite JDBC

Re: Settings to override default Ignite JDBC Thin Driver port 10800

Hello! On server, you can use Regards, -- Ilya Kasnacheev вт, 18 дек. 2018 г. в 16:20, Sriveena Mattaparthi < sriveena.mattapar...@ekaplus.com>: > Thanks Ilya, > > > > Could you please correct the settings to be done for overrring the default > port then? > > > >

RE: Settings to override default Ignite JDBC Thin Driver port 10800

Thanks Ilya, Could you please correct the settings to be done for overrring the default port then? Thanks & Regards, Sriveena From: Ilya Kasnacheev [mailto:ilya.kasnach...@gmail.com] Sent: Tuesday, December 18, 2018 6:21 PM To: user@ignite.apache.org Subject: Re: Settings to override default

Re: Settings to override default Ignite JDBC Thin Driver port 10800

Hello! Client connector port is a different thing than either communication port or discovery port. You don't have to override neither of those. Regards, -- Ilya Kasnacheev вт, 18 дек. 2018 г. в 15:49, Sriveena Mattaparthi < sriveena.mattapar...@ekaplus.com>: > Hi, > > > > We would like to

Settings to override default Ignite JDBC Thin Driver port 10800

Hi, We would like to override the default port 10800. For this we have made the below changes. On client node Ignition.setClientMode(true); ClientConnectorConfiguration clientCfg = new ClientConnectorConfiguration(); clientCfg.setPort(10850); IgniteConfiguration cfg = new

Re: Ignite in docker (Native Persistence)

Hi Rahul, Could you please share an ignite configuration and how do you launch a docker container with Ignite? Do you see something in your ignitedata/persistence ignitedata/wal ignitedata/wal/archive after container stop? I guess you can configure a consistentId by configuring

Re: Page size

Hello! I don't think you can have different page size per data region. Even if you could, max page size supported is 16k so it is unlikely to deliver substantial benefits. IGFS does store files in k/v cache, splitting into chunks, as far as my understanding goes. Regards, -- Ilya Kasnacheev

Re: deep learning over apache ignite

Hi, I'm a contributor of Ignite ML too and I'd like dl4j library too and have experience with that. I have a few experiments with integration but the main problem is tensor algebra implementation and effective Ignite cluster/caches usage. Could you provide a simple example of your draft ideas on

Re: Re: Partition-exchanger blocked after upgrade to 2.7

hi Ilya, Thanks! opening the verbose logger will run for day to collect the logging, the cluster did not stuck eventually, still can get response. Regards Aaron From: Ilya Kasnacheev Date: 2018-12-18 19:36 To: user CC: aaron Subject: Re: Re: Partition-exchanger blocked after upgrade to

Re: Re: Partition-exchanger blocked after upgrade to 2.7

Hello! It's still hard to say. Can you enable more verbose logging for org.apache.ignite? Did the cluster un-stuck eventually? Regards, -- Ilya Kasnacheev вт, 18 дек. 2018 г. в 14:25, aa...@tophold.com : > Hi Ilya, > > Attached is the full log of another ignite nodes. the data in the >

Re: Dealing with changing class definitions in Ignite

Hello! Can you show an example of "Ignite Runnables conflicting on the Binary Marshaller"? As a small code snippet perhaps? Maybe I could recommend something but I lack understanding of your use case. Regards, -- Ilya Kasnacheev пн, 17 дек. 2018 г. в 18:12, Gert Dubois : > Thanks for the

Re: How to benchmark IgniteDataStreamer?

Hello! You just, you know, benchmark Ignite Data Streamer. Collect currentTimeMillis() before data load started, compare to currentTimeMillis() after it is finished. I don't think that DataStreamer collects any metrics so that would be it. Regards, -- Ilya Kasnacheev вт, 18 дек. 2018 г. в

Re: Sql join cause memory exhausted

Hello! Then you will have to simplify your query or split it into parts to avoid pulling too many rows into RAM at the same time. Note that other databases also have this issue, but with Apache Ignite it's more severe since it would not hold temporary mid-query tables on disk. As far as I know

Re: Ignite client node connect to visor

Hello! Yes, visor starts a "daemon" node which is not shown in topology but acts as a real node. You will probably need to shut it down. Regards, -- Ilya Kasnacheev вт, 18 дек. 2018 г. в 09:02, ashishb008 : > It has been observed that: > 1. No server nodes up, and started client node, it

Re: Ignite Idle CPU usage

Hello! Ignite is not supposed to consume a lot of CPU when idle. Can you collect thread dump from Ignite JVM when it happens? Regards, -- Ilya Kasnacheev пн, 17 дек. 2018 г. в 23:19, mh : > Hello, > > I am currently trying to integrate Ignite 2.7 into an existing Web > Application built on

Re: Partition-exchanger blocked after upgrade to 2.7

Hello! Unfortunately it's hard to say what happens here from such short log snippet. Can you provide full logs? Regards, -- Ilya Kasnacheev вт, 18 дек. 2018 г. в 05:51, aa...@tophold.com : > Hello, > > After we upgrade to the 2.7 we meet a wired warn; basically all our > ignite cache

Re: Ignite in docker (Native Persistence)

Hi All, I followed following steps for persistence in docker but i am observing that cache is not retained after restart. From documentation i see that consisitentID need to be set to retain cache after restart but i am not sure how it can set in configuration xml file. Any help is greatly

Page size

Hi! I can only set the page size on the dataStorageConfiguration ? it is not possible to have different page size per dataRegionConfiguration ? All my caches have small values, less then 100 bytes but I have one cache with larger items, some a few hundred kb up to 2-3 mb, I would think

Re: Did anyone write custom Affinity function?

Hi! How many nodes do you have and what are you using for the affinity key ? there is of course a small chance that the distribution is not even but in most cases it will work fine as long as it has enough different values to choose from, but it depends a little bit on what you use for