Re: persist only on delete

Hi Val,Thanks very much. CacheInterceptor is the best way.Shawn On 02/7/2017 08:09，vkulichenko wrote： Hi Shawn, Your approach sounds a bit dangerous. Store is called within an entry lock, which means that if you do a distributed 

Re: persist only on delete

On 02/7/2017 09:07，shawn.du<shawn...@neulion.com.cn> wrote： Hi Val,Thanks very much. CacheInterceptor is the best way.Shawn On 02/7/2017 08:09，vkulichenko<valentin.kuliche...@gmail.com> wrote： Hi Shawn, Your approach sounds a bit dangerous. Sto

Re: simple file based persistent store support TTL

thanks Val.  On 02/2/2017 05:27， vkulichenko wrote： Hi Shawn, Built in expiration is cache expiration, which by definition 

how to get BinaryMarshaller instance

Hi,I want to persist some data in binary, for I put cache in BinaryObject format like this:BinaryObjectBuilder builder = ignite.binary().builder(typeName);cache.put(key,builder.build());how can I get or create BinaryMarshaller instance? 

Re: how to get BinaryMarshaller instance

get it. storeKeepBinary flag will help.  ThanksShawn On 02/8/2017 13:58，shawn.du<shawn...@neulion.com.cn> wrote： Hi,I want to persist some data in binary, for I put cache in BinaryObject forma

Re: simple file based persistent store support TTL

On 02/14/2017 11:44，shawn.du<shawn...@neulion.com.cn> wrote： Thanks Val, I forgot to enable them. I just got example code and run them.  Now it works. ThanksShawn On 02/14/2017 11:40，vkulichenko<

Re: simple file based persistent store support TTL

Thanks Val, I forgot to enable them. I just got example code and run them.  Now it works. ThanksShawn On 02/14/2017 11:40，vkulichenko wrote： Hi Shawn, Did you enable the event 

persist periodically

Hi,ignite support persist data periodically?see blow use case:we want to implement storm state management using ignite.we maintain storm stateful object as caches in ignite.for storm used processing message in very low latency, so the stateful object maybe changed very fast.if ignite

Re: persist periodically

Hi, Andrey,then do you know how to gracefully shut down ignite servers when write-behind enabled without data lose? ThanksShawn On 02/14/2017 14:04，shawn.du<shawn...@neulion.com.cn> wrote： e

Re: persist periodically

s your needs?[1] http://apacheignite.gridgain.org/v1.8/docs/persistent-store#write-behind-cachingOn Tue, Feb 14, 2017 at 8:40 AM, shawn.du <shawn...@neulion.com.cn> wrote: Hi,ignite support persist data periodically?see blow use case:we want to implement storm state mana

restore Java Object from BinaryObject

Hi,I implement a cacheStore, this cachestore will persist a binaryObject into bytes and store in MySQL blob. Exceptions occurred when calling loadCache function:binaryObject.deserialize() will throw exceptions like "Cannot find metadata for object with compact footer: -1615140068"If  I

Re: restore Java Object from BinaryObject

leases/mobile/org/apache/ignite/configuration/BinaryConfiguration.html#isCompactFooter().On Thu, Feb 9, 2017 at 1:28 PM, shawn.du <shawn...@neulion.com.cn> wrote: Hi,I implement a cacheStore, this cachestore will persist a binaryObject into bytes and store in MySQL blob. Ex

Re: simple file based persistent store support TTL

Hi Val,do you mean that when cache is expired, I have to call cache.remove(key) manually in order to call delete in cachestore?I try to implement by remote listener like this:ignite.events().remoteListen(null, new IgnitePredicate(){ @IgniteInstanceResource private Ignite ignite;

Re: restore Java Object from BinaryObject

My code error, BinaryObject deserialize twice. ThanksShawn On 02/11/2017 06:26，vkulichenko wrote： Shawn, What's the actual issue after you disabled compact footer? Exception?

Register CacheEvent Remote Listener

Hi,I want to only register listeners for cacheEvent, but I don't want to specify the particular cache.it is possible?like this code:ignite.events().remoteListen(null, new IgnitePredicate(){  } ThanksShawn

cache namespace support

Hi,I have a use case like below:I want to store key-value caches in ignite, but each key-value has a namespace. key are unique in a namespace.Each cache entry has the same data type for both key and value.When query, We always query by key and namespace.  sometimes, we query all caches

consistence issue

Hi,I have a cache. there may be thousands of cache entry. Each cache entry may be updated every several seconds. I update them using cache.invoke method which will update cache entry partially.Questions#1 when invoke method return at client side. other client will get the latest data?#2

回复：BinaryObject and String.intern

thanks dkarachentsev. 在2017年01月03日 18:25，dkarachentsev 写道:Actually no, because Ignite internally will store it as a BinaryObject and will send to other nodes in a binary format as well, where all string fields will be unmarshaled without intern(). -- View

Re: compute SQL returned data.

Hi,I think my case is a typical Map-Reduce problem.  I go through Ignite Compute API, but I don't see how ignite collocate compute and data when doing map-reduce.I describe my logic here:#1 client issues SQL query to server to get the cache keys. It is a very light task. #2 client sends

回复：Re: 答复: Cache.invoke are terribly slow and can't update cache

Thanks Val!Now I understood entryprocessor better. as to "error prone", I meant if we follow the document,it will be error prone.  For EntryProcessor is just an interface, it doesn't prohibit user to use lamda or anonymous classes. 

Re: CacheInterceptor issue

，Andrey Mashenkov<andrey.mashen...@gmail.com> wrote： Hi Shawn,CacheInterceptor should be called once on one node.On Wed, Mar 22, 2017 at 5:11 AM, shawn.du <shawn...@neulion.com.cn> wrote: Hi,If I have multiple-nodes cluster, and I set up a cache interceptor on a cach

Re: CacheInterceptor issue

it has a note in javadoc: * Implementations should not execute any complex logic,* including locking, networking or cache operations,* as it may lead to deadlock, since this method is called* from sensitive synchronization blocks.On Fri, Mar 24, 2017 at 4:16 AM, shawn.du <shawn...@neulion.com.

CacheInterceptor issue

Hi,If I have multiple-nodes cluster, and I set up a cache interceptor on a cache. the cache mode is partitioned or duplicated. in partition mode, the cache maybe have a backup or not.  My question is: when a cache entry is removed,  the interceptor will be called once on one node or

generic class support

Hi,see below configuration:                                                     java.lang.String                     com.example.MyClass                       MyClass is a generic class.  T can be Integer/Long/byte[]/String etc simple data type.public class MyClass{    @QuerySqlField     

messaging behavior

Hi,I am trying ignite topic based messaging. I wonder to know ignite behavior in blow case:Client A send a message with topic T1  to ignite server, but there are no topic listeners at this time, after for a while(like 1 or 2 minutes), Client B is online and subscribe topic T1, will

Re: messaging behavior

，Nikolai Tikhonov<ntikho...@apache.org> wrote： Hi,Ignite does not accumulate messages which were sent to non-exist topic. Messages will be lost in your case.On Mon, Jun 12, 2017 at 12:30 PM, shawn.du <shawn...@neulion.com.cn> wrote: Hi,I am trying ignite topic based

ignite compute debugging

Hi,I see many NullPointerException in my ignite log. like this:java.lang.NullPointerException[15:41:05,542][SEVERE][pub-#5702%null%][GridJobWorker] Failed to execute job due to unexpected runtime exception [jobId=751a821cc51-a76e994f-a6fc-4483-9063-2a51edb5195e,

integrate with prestodb

Hi community,I am trying to implement a connector for presto to connect ignite.  I think it will be a very interest thing to connect ignite and presto.In fact, currently we use ignite and it works very well.  but in order to save memory, we build compressed binary data.thus we

Re: integrate with prestodb

n, Oct 16, 2017 at 12:14 PM, shawn.du <shawn...@neulion.com.cn <mailto:shawn...@neulion.com.cn>> wrote: > Hi community, >  > I am trying to implement a connector for presto to connect ignite.  > I think it will be a very interest thing to connect ignite and presto. >  >

Re: integrate with prestodb

, your compression becomes optional. [1] https://ignite.apache.org/features/persistence.html  — Denis > On Oct 16, 2017, at 7:18 PM, shawn.du <shawn...@neulion.com.cn> wrote: >  > Hi Denis, >  > Yes, We do want to limit the RAM to less than 64G.  RAM resource is still an expensive resou

Re: create two client instance in one JVM to connect two ignite

Hi Val,I want to do something like below:Ignition.setClientMode(true);Ignite ignite1 = Ignition.start(config1);Ignite ignite2 = Ignition.start(config2); with above 2 ignite client instance, so that I can query from one and put the query result into the other manually, even with

create two client instance in one JVM to connect two ignite cluster

Hi,It seems that ignite can't do as the topic describe. I want to do data synchronization manually between two cluster, any suggest? ThanksShawn

Re: create singleton instance in ignite server side.

fixed. Some library is missing. ThanksShawn On 12/18/2017 13:20，shawn.du<shawn...@neulion.com.cn> wrote： Hi,I am using https://github.com/RuedigerMoeller/fast-serialization for ser/des.m

create singleton instance in ignite server side.

Hi,I am using https://github.com/RuedigerMoeller/fast-serialization for ser/des.my code is rather simplepublic class EncoderSerDes{private static ISerDes serDes = new FstSerDes();public static byte[] serialize(ColumnEncoder encoder) throws Exception{return

Re: memory usage in 2.3

Thank you Denis,I think OOM is caused by invalid configuration. for I supposed ignite use on-heap memory,  I set a very big value for -Xmx -Xms, in this way, memory left for off-heap and other programs is limited. We are run testing now, till now all seems good.

memory usage in 2.3

Hi,I upgrade my ignite version from 1.9 to 2.3. In 1.9, We store all data in memory. I know that in ignite 2.0+, ignite use off-heap memory by default.so I change my code like below:  config.setOnheapCacheEnabled(true);but after running several hours, my server is crash for

deadlock

Hi, My ignite server stop to response.  Any client can't connect it, and I found dead lock in logs,what's the possible reason for this?  I use ignite 1.9.0.Thanks in advance.log===deadlock: truecompleted: 29519967Thread

Re: ignite server cpu is high

. But yesterday it is a exception. Very strange. shawn.du

Re: ignite server cpu is high

’t get more info now, the cpu issue is gone as now there are very few traffic on our system.  For our case,we store data into ignite every 30 seconds. If no query, the cpu should be very low. But yesterday it is a exception. Very strange. shawn.du邮箱：shawn...@neulion.com.cn Signature is customized

ignite server cpu is high

Hi Community,My single-node ignite cluster has started since Apr 23. In past couple weeks, It worked fine. For our case, Ignite server's CPU is very low at most time with exception that there are complex/concurrent queries.event in case of query, ignite server's CPU will be high for

off heap memory usage

Hi community,I want monitor ignite cluster off heap memory usage. if off heap available memory is less than 1G then alert. I went through ignite MBean,  find ClusterLocalNodeMetricsMXBeanImpl's NonHeapMemoryUsed. The value is too small. I don't think it is.  How can I get it?

set table schema in sqlline command line

Hi,I am trying sqlline in CLI,./sqlline.sh --color=true --verbose=true -u jdbc:ignite:thin://127.0.0.1/I can connect ignite successfully, also command !tables can list all tables.but when I query something, it always fail. 

compute ignite data with spark

Hi,Spark is a compute engine.  Ignite also provide compute feature. Also Ignite can integrate with spark.We are using ignite compute map-reduce feature now.  It is very fast.I am just curious how spark compares with ignite on computing.it is possible using spark API computing ignite

how to dismiss a ignite server node.

Hi,Suppose I have several ignite server nodes which compose a cluster.all data in PARTITIONED mode, and with no backups.It is possible to dismiss a node without restarting and data lose?if possible, what are the steps? ThanksShawn

Re: how to dismiss a ignite server node.

+03:00 shawn.du <shawn...@neulion.com.cn>: Hi,Suppose I have several ignite server nodes which compose a cluster.all data in PARTITIONED mode, and with no backups.It is possible to dismiss a node without restarting and data lose?if possible, what a

connection pool in ignite

Hi,Is there connection pool concept in ignite client?I notice there are only one TCP connection between my ignite client and server.Currently I don't find any issues with it, but please explain.If a client communicate(put/get/query) with server heavily, does one connection is

Re: Ignite Client Heap out of Memory issue

error, but JVM OOM. So, try to investigate if there is a memory leak in your code.On Fri, Mar 30, 2018 at 6:36 AM, shawn.du <shawn...@neulion.com.cn> wrote: Hi,My Ignite client heap OOM yesterday.  This is the first time we encounter this issue.My ignite client colocates within

Ignite Client Heap out of Memory issue

Hi,My Ignite client heap OOM yesterday.  This is the first time we encounter this issue.My ignite client colocates within Storm worker process. this issue cause storm worker restart.I have several questions about it: our ignite version is 2.3.01) if ignite in client mode, it use

Re: compute ignite data with spark

Hi, stan,Thanks. I am evaluating igniteRDD. it is cool!  I am new to spark, I can get sqlContext by ds.sqlContext.If I want to query all using select, what's the table name?see below in spark-shell,  I want to do something like > sc.sql("select * from ").  Where is the table

Re: compute ignite data with spark

Hi Denis,Thanks, that's cool! looking forward 2.4.0 release. ThanksShawn On 2/28/2018 12:11，Denis Magda wrote： Hi Shawn,In addition to RDDs, you'll be able to use Data Frames APIs soon