Re: IN Query

2016-10-27 Thread Anil
Hi Val, the below one is multiple IN queries with AND but not OR. correct ? SqlQiuery with join table worked for IN Query and the following prepared statement is not working. List inParameter = new ArrayList<>(); inParameter.add("8446ddce-5b40-11e6-85f9-005056a90879");

Re: BinaryObject pros/cons

2016-10-27 Thread Valentin Kulichenko
Cross-posting this to dev list. Vladimir, To be honest, I don't see much difference between null values for objects and zero values for primitives. From BinaryObject semantics standpoint, both are default values for corresponding types. These values will be returned from the BinaryObject.field()

答复: BinaryObject pros/cons

2016-10-27 Thread Shawn Du
Hi, In one of our project, we compact java objects which have lots of long zeros. It save disk greatly when serialization. Thus slow Disk IO operations become fast CPU operations and performance is improved. Data compact algorithm is inspired by this paper

Re: Any plan for a book on Apache Ignite

2016-10-27 Thread Denis Magda
Prachi, Would you add a reference to this book [1] under “Community”->”Resources” section? It contains useful and valuable information a lot of guys who will start working with Ignite will benefit from. [1] https://leanpub.com/ignite — Denis > On Sep 18, 2016,

Freshest Articles About Ignite

2016-10-27 Thread Denis Magda
Igniters, Just want to share with you interesting articles I've came across recently. This might be a good reading for your upcoming weekend. Deep dive into Apache Ignite architectures and components:

Re: aiex webSocket error

2016-10-27 Thread Alec Lee
When I inspect on Chrome, the error is like this: ocLazyLoad.componentLoaded Array[3] angular.js:11706 ocLazyLoad.moduleLoaded toaster 4livereload.js?host=localhost:74 WebSocket connection to 'ws://localhost:35729/livereload' failed: Error in connection establishment:

Re: BinaryObject pros/cons

2016-10-27 Thread Vladimir Ozerov
Hi, I am not very concerned with null fields overhead, because usually it won't be significant. However, there is a problem with zeros. User object might have lots of int/long zeros, this is not uncommon. And each zero will consume 4-8 additional bytes. We probably will implement special

Re: Apache Spark & Ignite Integration

2016-10-27 Thread vkulichenko
Hi, There is no direct support for data frames or data sets right now. This is planned for the future though. For now you can convert IgniteRDD to data set and any other RDD (IgniteRD is an extension of RDD), but you will lose all the advantages. Both savePairs and sql methods are available only

Re: Ignite + Spark Streaming on Amazon EMR Exception

2016-10-27 Thread vkulichenko
Well, the exception is actually coming from Spark, not Ignite, so the issue is most likely there. System provided I suggested should fix the issue in any case though. Not sure how this should be done in EMR. -Val -- View this message in context:

Re: Does read-through work with replicated caches ?

2016-10-27 Thread vkulichenko
Ignite doesn't do merge, see my explanation here: http://apache-ignite-users.70518.x6.nabble.com/Cluster-breaks-down-on-network-failure-td8549.html -Val -- View this message in context:

Re: PeerClassLoading for Cache Load

2016-10-27 Thread vkulichenko
This is not correct. Peer class loading should be used only for Compute Grid (closures and distributed tasks). Classes that are part of cache configuration (cache store implementations, eviction and expiry policies, etc.) must be explicitly deployed on all server nodes. For model classes that are

Re: Inject the data through IgniteDataStreamer

2016-10-27 Thread vkulichenko
Hi, It can be any class that is serialized by binary marshaller. In your case it's most likely one of your classes that are streamed via streamer and/or stored in cache. -Val -- View this message in context:

Re: BinaryObject pros/cons

2016-10-27 Thread vkulichenko
Hi, Yes, null values consume memory. I believe this can be optimized, but I haven't seen issues with this so far. Unless you have hundreds of fields most of which are nulls (very rare case), the overhead is minimal. -Val -- View this message in context:

Re: jvm setting to turn off the Garbage collector

2016-10-27 Thread vkulichenko
Abhishek, There is no way to entirely disable GC. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/jvm-setting-to-turn-off-the-Garbage-collector-tp8508p8561.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: MapReduce with Apache-Ignite

2016-10-27 Thread vkulichenko
lalit wrote > You've mentioned that spilling task is worked upon. Does it mean in the > current version because of eviction we may loose mapper output? or the > node will crash complaining the out of memory error? In this case Ignite will consume all the available memory and crash with OOME.

Re: jvm setting to turn off the Garbage collector

2016-10-27 Thread Abhishek Jain
Thanks Val for your response. We want to perform some memory analysis. Regards Abhishek On Wed, Oct 26, 2016 at 2:47 PM, vkulichenko wrote: > Hi Abhishek, > > If you disable GC, you will run out of memory very quickly. Can you please > clarify why you want to do

Re: Ignite + Spark Streaming on Amazon EMR Exception

2016-10-27 Thread Geektimus
Hi Val,Thanks for your suggestion, the thing at this point is that this is running inside EMR (Elastic Map Reduce in Amazon) in embedded mode and I don't have control over the system properties. I tried to use them inside a bootstrap action for the cluster and I found that it was deprecated for

Re: Killing a node under load stalls the grid with ignite 1.7

2016-10-27 Thread bintisepaha
yes I think you are write. Is there any setting that we can use in write behind that will not lock the entries? the use case is we have is like this Parent table - Order (Order Cache) Child Table - Trade (Trade Cache) We only have write behind on Order Cache and when writing that we write order

Re: Does read-through work with replicated caches ?

2016-10-27 Thread Marcus Simonsen
I am also interested in this topic as it's relevant to my use case. Wouldn't you need to configure segmentation policy? https://gridgain.readme.io/docs/network-segmentation Hazelcast had a concept of merge strategy to recover reconcile data - I'm not sure if Ignite has something similar.

Re: AssertionError

2016-10-27 Thread thammoud
Thank you. I've been trying to reproduce to no avail. Glad you found the cause. Will keep an eye. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/AssertionError-tp8321p8554.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: org.h2.api.JavaObjectSerializer not found

2016-10-27 Thread flexvalley
Sorry i'm new with this forum... i post without sub before -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/org-h2-api-JavaObjectSerializer-not-found-tp8538p8553.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

IN Query

2016-10-27 Thread Anil
HI, i am using dynamic table join to support IN Query as given in the ignite documentation. How to write query with multiple IN queries with OR condition ? other than UNION. Ex : name IN ('a', 'b') OR id IN ('1', '2') Thanks

Re: Does read-through work with replicated caches ?

2016-10-27 Thread Kristian Rosenvold
What we don't understand is that after a network failure, we see requests for data that was processed by node A (replicated cache running write through) that is not visible to node B. At the time of the request, node B has no in-memory knowledge of the data (since it was just created by Node A),

Re: Does read-through work with replicated caches ?

2016-10-27 Thread Vladislav Pyatkov
Hi, It will be working, because replicated cache implemented as partition with number of backups equivalent to number of nodes. On Thu, Oct 27, 2016 at 2:13 PM, Kristian Rosenvold wrote: > Does this configuration actually do anything with a replicated cache, if > so what

Does read-through work with replicated caches ?

2016-10-27 Thread Kristian Rosenvold
Does this configuration actually do anything with a replicated cache, if so what does it do ? Kristian

PeerClassLoading for Cache Load

2016-10-27 Thread Labard
Hi. I want to use peerClassLoading for cacheConfig. I have empty config on servers nodes, and different configs with few caches and Persistent Store Adapters on few client nodes. I work with all nodes in one cluster. Can I use peerClassLoading instead of deploying all cache and adapters classes on

答复: 答复: ignite used too much memory

2016-10-27 Thread Shawn Du
Hi Andrey Mashenkov, I checkout pr/1101 pr/1037 and have a test both of them. Things maybe go better but not resolved. This is my cache state, I think it is full, for code like this: config.setSwapEnabled(swapEnable); if (swapEnable) { EvictionPolicy policy = new

答复: 答复: ignite used too much memory

2016-10-27 Thread Shawn Du
BTW, I use ONHEAD_TIERED memory mode. I don’t enable off heap. Thanks Shawn 发件人: Shawn Du [mailto:shawn...@neulion.com.cn] 发送时间: 2016年10月27日 15:30 收件人: 'user@ignite.apache.org' 主题: 答复: 答复: ignite used too much memory Hi Andrey Mashenkov, I checkout pr/1101 pr/1037 and have a

Re: How to avoid data skew in collocate data with data

2016-10-27 Thread Vladislav Pyatkov
Hi, One AffinityKey binding to one node always. This is AffinityKey meaning (all entries with one AffinityKey stored into one node). On Thu, Oct 27, 2016 at 9:45 AM, ght230 wrote: > If there are too many data related to one affinity key, even more than the > capacity of one

BinaryObject pros/cons

2016-10-27 Thread Shawn Du
Hi expert, BinaryObject gives great convenience to create dynamic objects. Does it have disadvantages? Take below example, does each field name will consume memory or not? Many RDBMS which has fixed table schema, column name willn't use memory/disk. How does it for BinaryObject? If

Re: [EXTERNAL] Re: SLF4J AND LOG4J delegation exception with ignite dependency

2016-10-27 Thread chevy
Attached gradle file. Please help me out to resolve exception caused by ignite-http-rest as I need to use rest services. -- Regards, Chetan. From: "vdpyatkov [via Apache Ignite Users]" Date: Wednesday, October 26, 2016 at 8:24 PM To: "Chetan.V.Yadav"

Re: How to avoid data skew in collocate data with data

2016-10-27 Thread ght230
If there are too many data related to one affinity key, even more than the capacity of one node. Will Ignite automatically split that data and stored them in several nodes? -- View this message in context: