Re: Ignite Cluster Communication with SSH Tunnels

2016-10-11 Thread Denis Magda
Hi Krzysztof, Definitely, AddressResolver can be used for the purposes when you need to connect nodes that are behind NAT with the other ones. Basically, in an AddressResolver configuration each node should simply list a mapping of *its* private addresses to *its* external addresses. After that

Re: Ignite Cluster Communication with SSH Tunnels

2016-10-11 Thread Krzysztof
Hello, We would appreciate confirmation that GridDhtAssignmentFetchFuture::requestFromNextNode() makes impossible to have a client communicating via NAT, even with AddressResolver - or a pointer where we make a mistake in the code/logic. Judging by the code, GridDhtAssignmentFetchFuture has no

Re: Iginte - Exception - Failed to unmarshal discovery data for component: 1 - on starting server from console and an application in eclipse IDE

2016-10-11 Thread M Singh
I will definitely let you know if I can reproduce it, but just for my own understanding, as you saw in the sample, I was just storing strings, so what could have caused the serialization exception?  Just want to avoid misusing the API. On Tuesday, October 11, 2016 8:14 AM, Sergej Sidorov

Re: Near cache

2016-10-11 Thread javastuff....@gmail.com
Thank you for your reply. Would like to add more details to 3rd point as you have not clearly understood it. Lets assume there are 4 nodes running, node A brings data to distributed cache, as concept of Near Cahce I will push data to distributed cache as well as Node A will have it on heap in Map

Re: Cache read through with expiry policy

2016-10-11 Thread o4oxide
Hello Val, Sorry I got it wrong on how expiry works with the cache store. I had thought it will call a delete to remove it from the store when it expires. I just realized that is not the case so an expiry only removes from cache not from cache store. Thanks for the good job. Best Regards, --

RE: Evicted entry appears in Write-behind cache

2016-10-11 Thread Pradeep Badiger
Hi Denis, I did the get() on the evicted entry from the cache, it still returned me the value without calling the load() on the store. As you said, the entry would be cached in the write behind store even for the evicted entry. Is that true? Thanks, Pradeep V.B. From: Denis Magda

Re: Loading Hbase data into Ignite

2016-10-11 Thread Anil
Thank you Vladislav and Andrey. I will look at the document and give a try. Thanks again. On 11 October 2016 at 20:47, Andrey Gura wrote: > Hi, > > HBase regions doesn't map to Ignite nodes due to architectural > differences. Each HBase region contains rows in some range of

Re: Loading Hbase data into Ignite

2016-10-11 Thread Anil
HI Alexey, We are planning to have 4 node cluster. we will increase the number of nodes based on performance. key is string which unique (some part of hbase record primary key which is unique). Each record has around 25-30 fields but that is small only. Record wont have much content. All 18 M

Re: Loading Hbase data into Ignite

2016-10-11 Thread Andrey Gura
Hi, HBase regions doesn't map to Ignite nodes due to architectural differences. Each HBase region contains rows in some range of keys that sorted lexicographically while distribution of keys in Ignite depends on affinity function and key hash code. Also how do you remap region to nodes in case of

Re: Iginte - Exception - Failed to unmarshal discovery data for component: 1 - on starting server from console and an application in eclipse IDE

2016-10-11 Thread Sergej Sidorov
Hi, For internal activities ignite use only work directory. Let me know if the issue is reproduced again. -Sergej -- View this message in context:

Re: Is it possible to enable both REPLICATED and PARTITIONED?

2016-10-11 Thread Tracy Liang (BLOOMBERG/ 731 LEX)
Thanks Alexey. Maybe in the future. Right now it's hard. Also from consistency point of view, I saw there are FULL_SYNC for strong consistency, but that might cause weak availability for writing. Does ignite support quorum consistency? From: user@ignite.apache.org Subject: Re: Is it possible

Re: Is it possible to enable both REPLICATED and PARTITIONED?

2016-10-11 Thread Tracy Liang (BLOOMBERG/ 731 LEX)
Thanks Vlad. So it's like I define a custom class for my use case(Basically a logic view of the table and column) like this: https://github.com/apache/ignite/blob/master/examples/src/main/java/org/apache/ignite/examples/model/Person.java. And then I create Ignite cache with type and

Re: Loading Hbase data into Ignite

2016-10-11 Thread Vladislav Pyatkov
Hi, The easiest way do this using DataStrimer[1] from all server nodes, but with specific part of data. You can do it using Ignite compute[2] (matching by node id for example or node parameter or any other) with part number as a parameter to SQL query for HDB. [1]:

Re: Loading Hbase data into Ignite

2016-10-11 Thread Alexey Kuznetsov
Hi, Anil. It depends on your use case. How many nodes will be in your cluster? All 18M records will be in one cache or many caches? How big single record? What will be the key? You need only load or you also need write changed / new objects in cache to HBase? On Tue, Oct 11, 2016 at 8:11 PM,

Re: secured mesos deployment

2016-10-11 Thread Nikolay Tikhonov
Hi Vincent, Ignite Mesos Framework connecting to mesos via current user. I've created ticket on adding new functionality which will allow to set user name and principal (https://issues.apache.org/jira/browse/IGNITE-4052 feel free to contribute ;) ). But if your user equals user for mesos cluster

Loading Hbase data into Ignite

2016-10-11 Thread Anil
HI, we have around 18 M records in hbase which needs to be loaded into ignite cluster. i was looking at http://apacheignite.gridgain.org/v1.7/docs/data-loading https://github.com/apache/ignite/tree/master/examples is there any approach where each ignite node loads the data of one hbase region

Re: Near cache

2016-10-11 Thread Vladislav Pyatkov
Hi, I think you will get long delay when updated local map entry, and general issue you will be generate garbage, which increase garbage collector load and consume of a heap. The delay will not by long, but depends of communication layer. I have not understand this. Why can not use one listener

Re: IN Query

2016-10-11 Thread Vladislav Pyatkov
Hi, Try do it like: SqlFieldsQuery query = new SqlFieldsQuery(sql).setArgs(inParameter.toArray(), anotherINParameter.toArray()) If you have more the one args, the method will be work. On Tue, Oct 11, 2016 at 3:08 PM, Anil wrote: > ignite supports multiple IN queries ? i

Re: IN Query

2016-10-11 Thread Anil
ignite supports multiple IN queries ? i tried the following and no luck. String sql = "select p.id, p.name from Person p join table(name VARCHAR(15) = ?) i on p.name = i.name join table(id varchar(15) = ?) k on p.id = k.id"; SqlFieldsQuery query = new SqlFieldsQuery(sql).setArgs(new Object[] {

Re: DataStreamer pool

2016-10-11 Thread thammoud
Meant to say Partitioned cache. Sorry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/DataStreamer-pool-tp5857p8203.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Ignite .NET on Linux

2016-10-11 Thread Pavel Tupitsyn
Hi, I think there are only two windows-specific things in Apache.Ignite.Core.dll: * Embedded windows dll with JNI interop code, which is loaded in UnmanagedUtils class initializer via LoadLibrary system call * IgniteUtils.LoadJvmDll, which uses registry to locate Java installation paths So if

Re: Is it possible to enable both REPLICATED and PARTITIONED?

2016-10-11 Thread Alexey Kuznetsov
Hi Tracy, In addition to Vlad answer about SQL fields query I would like to mention, that may be you can implement your functionality directly in Ignite without Spark? Ignite has a lot of features: in memory key-value storage, SQL and scan queries and Compute engine for map reduce (and much

Re: Cache read through with expiry policy

2016-10-11 Thread o4oxide
Hi vkulichenko, This is still open and I also noticed it affects write through and write behind as well. Could you advise of a work around for now as I really need this feature. Thanks -- View this message in context:

Re: secured mesos deployment

2016-10-11 Thread vincent gromakowski
Hi My mesos is configured to ask for login and password. So it rejects ignite framework... Le 11 oct. 2016 3:10 AM, "Denis Magda" a écrit : > I’m not an expert in Apache Mesos but think that this can be done using > standard Mesos configuration files. However, it depends on