Range queries on indexed columns

2017-06-12 Thread Anil
HI Team, I have a table TEST with a indexed column COL_A. Does the following query works ? select * from Test where COL_A > '1' and COL_A < '2' offset 10 ROWS FETCH NEXT 20 ROWS ONLY As per my understanding of distributed systems, the query is sent to all nodes and gets the 10 records from

Re: Off-Heap On-Heap in Ignite-2.0.0

2017-06-12 Thread Megha Mittal
Hi Denis, thanks for answering. That completely cleared out my doubt. I would like to know one more thing. I was testing with ~1000 (10 million) records with each records of ~1400 bytes. When I was trying to keep everything on-heap I had to allocate around 15GB to on-heap to store all these

how to look at content of igfs

2017-06-12 Thread Antonio Si
Hi, I have configured ignite to use hdfs as the secondary file system and I have write the content of a dataframe to igfs. Browsing the hdfs, I can see the files being written to hdfs. But is there a way I can look at the content of igfs directly? Would I be able to do that in ignitevisorcmd ?

Re: Off-Heap On-Heap in Ignite-2.0.0

2017-06-12 Thread Denis Magda
Megha, > Or is it required to give 1 GB to off heap > memory region with no relation how much I allocate to on-heap. That’s the correct point. All the data is stored in off-heap by default. If you give 500 MB to the off-heap then you’ll get out of memory exception once you go beyond that

Re: Concurrent job execution and FifoQueueCollisionSpi.parallelJobsNumber=1

2017-06-12 Thread Ryan Ripken
I use IgniteMessaging to update status info from inside my compute jobs so publicThreadPoolSize=1 probably isn't going to work. In your opinion, would a new CollisionSpi implementation that synchronized the onCollision method resolve the issue? On 6/9/2017 5:01 PM, vkulichenko wrote:

Re: Grid/Cluster unique UUID possible with IgniteUuid?

2017-06-12 Thread Muthu
Thanks Nikolai..this is what i am doing...not sure if this is too much..what do you think..the goal is to make sure that a UUID is unique across the entire application (the problem is each node that is part of the cluster would be doing this for different entities that it owns) ... ...

Re: Automatic Persistence : Unable to bring up cache with web console generated models ("org.apache.ignite.IgniteCheckedException: Failed to register query type" exception is thrown)

2017-06-12 Thread Muthu
Thanks Alexey. Got it. Thanks for the helpful responses. For the other issues w.r.t model generation & spring transaction integration would it help to share my small POC project on GitHub? I think these would be very helpful to have fixed. I can also submit a bug request if needed. I have some

Re: swift store as secondary file system

2017-06-12 Thread Antonio Si
Thanks Nikolai. I am wondering if anyone has done something similar. Thanks. Antonio. On Mon, Jun 12, 2017 at 3:30 AM, Nikolai Tikhonov wrote: > Hi, Antonio! > > You can implement your own CacheStore which will propagate data to the > swift. Or do you mean other

Re: System Parameters to improve CPU utilization

2017-06-12 Thread Nikolai Tikhonov
Hi, Can provide more details about your case? Which operations you perform under grid? On Fri, Jun 9, 2017 at 1:21 PM, rishi007bansod wrote: > Hi, >For my ignite data caching process i have recorded following > statistics. In which I have found my CPU

Re: Automatic Persistence : Unable to bring up cache with web console generated models ("org.apache.ignite.IgniteCheckedException: Failed to register query type" exception is thrown)

2017-06-12 Thread Alexey Kuznetsov
Muthu, >>2. With Ignite/Web Console, if a DB table insert/update/delete operation were to happen to the database directly is there a way to have that automatically picked up into the cache (so its always in sync with the DB tables)? >> I know this is too much to ask. I ask because we currently

RE: ignite 1.5 network imbalance

2017-06-12 Thread Libo Yu
I can give you the numbers. I have no idea why server 1 sent so much data to server 2 and 3. Server 1 bytes sent = 51096699125 bytes received = 3457376624 Server 2 bytes sent = 3631468045 bytes received = 27549879339 Server 3 bytes sent = 2172264793 bytes received = 23901316825 From:

Re: High heap on ignite client

2017-06-12 Thread Anil
Do you have any advice on implementing large records export from ignite ? I could not use ScanQuery right as my whole application built around Jdbc driver and writing complex queries in scan query is very difficult. Thanks On 10 June 2017 at 18:48, Anil wrote: > I

Re: messaging behavior

2017-06-12 Thread Nikolai Tikhonov
Hi, Ignite does not accumulate messages which were sent to non-exist topic. Messages will be lost in your case. On Mon, Jun 12, 2017 at 12:30 PM, shawn.du wrote: > Hi, > > I am trying ignite topic based messaging. I wonder to know ignite behavior > in blow case: > >

Ignite Cache Metrics

2017-06-12 Thread Megha Mittal
Hi, I am trying to access Ignite-2.0.0 cache metrics. I have loaded one cache into my cluster of 2 nodes with 1 backup (onHeapEnabled=false) At an instant of time I am getting below ignite cache size using : itemCache.size(CachePeekMode.OFFHEAP) = 2645679 itemCache.size(CachePeekMode.PRIMARY) =

Re: ignite 1.5 network imbalance

2017-06-12 Thread Nikolai Tikhonov
Hi Libo! Would you describe your imbalance in percent? Also can you try to upgrade Ignite to 1.9 and check it? On Fri, Jun 9, 2017 at 11:05 PM, Libo Yu wrote: > Hi, > > > > We have used embedded ignite cache on three application servers which are > behind a load balancer. > >

Re: swift store as secondary file system

2017-06-12 Thread Nikolai Tikhonov
Hi, Antonio! You can implement your own CacheStore which will propagate data to the swift. Or do you mean other integration with this product? On Sat, Jun 10, 2017 at 9:04 AM, Antonio Si wrote: > Hi Alexey, > > I meant a swift object storage:

Re: FW: QueryCursor.iterator() hanges forever

2017-06-12 Thread Nikolai Tikhonov
Hello, It looks strange. Could you share full example (how maven project)? Which version of apache ignite do you use? On Sat, Jun 10, 2017 at 1:14 PM, Reshma Bochare wrote: > Same thing works fine if executed at server side > > > > *From:* Reshma Bochare > *Sent:* Friday,

Re: Grid/Cluster unique UUID possible with IgniteUuid?

2017-06-12 Thread Nikolai Tikhonov
Muthu, Yes, you can use IgniteUUID as unique ID generator. What you will use depends your requirements. IgniteAtomicSequence takes one long and IgniteUUID takes 3 long. But getting new range sequence is distributed operation. You need to decied what more critical for your. On Fri, Jun 9, 2017 at

messaging behavior

2017-06-12 Thread shawn.du
Hi,I am trying ignite topic based messaging. I wonder to know ignite behavior in blow case:Client A send a message with topic T1  to ignite server, but there are no topic listeners at this time, after for a while(like 1 or 2 minutes), Client B is online and subscribe topic T1, will

Re: Node can't start. java.lang.NullPointerException in GridUnsafe.compareAndSwapLong()

2017-06-12 Thread Nikolai Tikhonov
Hi, Seems that known issue with IBM JDK http://www-01.ibm.com/support/docview.wss?uid=swg1IV76872. You need to update on jdk which contains fixes. On Fri, Jun 9, 2017 at 7:06 PM, Vladimir wrote: > Hi, > > Having no problems on Windows and Linux application suddenly couldn't

Re: Off-Heap On-Heap in Ignite-2.0.0

2017-06-12 Thread Megha Mittal
Hi Denis, Thanks for your reply. The video was helpful. But I am still not clear on the fact that if I have 1 GB data, with onHeapCaching enabled if I give my off heap memory region a maximum size of 500 MB and 1 GB to my heap, then will this configuration work. Or is it required to give 1 GB to

Re: Data Analysis and visualization

2017-06-12 Thread Ishan Jain
I need to just get the price of a stock which is stored in hdfs with timestamp and make a graph with the prices of that stock over time. On Mon, Jun 12, 2017 at 1:03 PM, Jörn Franke wrote: > First you need the user requirements - without them answering your > questions

Re: Data Analysis and visualization

2017-06-12 Thread Jörn Franke
First you need the user requirements - without them answering your questions will be difficult > On 12. Jun 2017, at 07:08, ishan-jain wrote: > > I am new to BIG Data .Just been working for a month. > I have HDFS data of stock prices. I need to perform data