Re: How to accelerate the query speed in Partitioned Mode

2016-06-24 Thread ght230
The data to be queried is more about 700,000 records and every record includes 10 fields. When I loaded the data to only one node, query TPS is about 66,000. If I load the data to 4 nodes by Partitioned Mode, query TPS is about 40,000. The queried field is the key and has be indexed. -- View

Re: Correlated Subquery Performance

2016-06-24 Thread Barrett Strausser
Yes. The first way is performant enough. I tried the latter and get the plan below. It appears the optimizer is not using the internalMissionId index? I have it defined as an additional standalone index such as @QuerySqlField(index = true, orderedGroups={@QuerySqlField.Group( name

Re: How to get the configuration of a given cache in Apache Ignite?

2016-06-24 Thread Alexey Goncharuk
Hi, As Andrey pointed out, now you can grab an expiry policy factory from Ignite's cache configuration, create an instance and get durations you need. I agree that this way a bit awkward and it only covers a configured ExpiryPolicy, currently there is no way to check if an instance of IgniteCache

Re: System.exit() not exiting cleanly (locked on IgnitionEx$IgniteNamedInstance)

2016-06-24 Thread bintisepaha
We are seeing multiple issues with 1.6.0 with dataStreamer and when server nodes are killed, the grid becomes unstable and unresponsive. So at this point we cannot really use 1.6 here is the thread dump for the thread you asked for and the ones I thought were relevant. I will try to get all

Re: How to get the configuration of a given cache in Apache Ignite?

2016-06-24 Thread AndreyVel
Sorry, you can get ExpiryPolicy without hacking Factory factory = cacheCfg.getExpiryPolicyFactory(); ExpiryPolicy policy = factory.create(); long timeToLive = policy.getExpiryForCreation().getDurationAmount(); -- View this message in context:

Re: How to get the configuration of a given cache in Apache Ignite?

2016-06-24 Thread AndreyVel
Hello yucigou, You code nice only for implementation CreatedExpiryPolicy, Ignite cache configuration has signature setExpiryPolicyFactory(Factory factory) you can create any logic for expiration, for example depends from stock market or earth shake. In such implementation TimeToLive is not

Re: Ignite Java and C++ example

2016-06-24 Thread amitpa
Fixed the problem there is a Clear cache code in C++ that was the problem. The cache was cleared before C++ tried to fetch the data and hence had errors... Thsi works fine -- View this message in context:

Ignite Java and C++ example

2016-06-24 Thread amitpa
Hi, I am trying to load data from Java and use it in C++. I think if I load from C++ and see in Java it works fine. But from Java the C+= example seems yto give me no errors but deserializes a default type. Obviously I must be missing something. I am attaching the Java code. The C++ example

Re: How to call loadCache before node is started ?

2016-06-24 Thread Alexei Scherbakov
Hi, Kristian. It looks like an issue which was recently fixed. Try set CacheRebalanceMode.ASYNC. 2016-06-22 14:54 GMT+03:00 Kristian Rosenvold : > If I fill the newly created Replicated cache with IgniteDataStreamer, > replication works as expected. If I use loadCache,

Re: Ignite with Cassandra and SSL

2016-06-24 Thread Denis Magda
Hi, First of all you need to create an SSLContext object and use it to initialize SSLOptions. Here is a good example [1] provided by Cassandra community. After that pass this SSLOptions object into Ignite's Cassandra DataSource object using DataSource.setSslOptions method. [1]

Re: Correlated Subquery Performance

2016-06-24 Thread AndreyVel
Hello bearrito, What Execution plan in you query, indexes used? https://apacheignite.readme.io/docs/sql-queries#using-explain You query can split to 2 different query SELECT internalMissionId FROM STATEFULROBOTTELEMETRY S2 WHERE S2.internalRobotName = ? ORDER BY internalTimeStamp DESC LIMIT 1

Re: Strange collocated distributed set behavior

2016-06-24 Thread zshamrock
Hi, Andrey. Any progress with this? Was you able to reproduce this one on your machine? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Strange-collocated-distributed-set-behavior-tp5643p5884.html Sent from the Apache Ignite Users mailing list archive at

Re: i have a question,asynchronous write no success

2016-06-24 Thread AndreyVel
Property writeThrough missed in you config file. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/i-have-a-question-asynchronous-write-no-success-tp5869p5883.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

RE: performance issues

2016-06-24 Thread Pradeep Badiger
Thanks Denis. From: Denis Magda [mailto:dma...@gridgain.com] Sent: Friday, June 24, 2016 1:00 AM To: user@ignite.apache.org Subject: Re: performance issues Hi Pradeep, Member-member (server-server) performance is better than client-server one in the scenario because in the first case roughly a

Re: System.exit() not exiting cleanly (locked on IgnitionEx$IgniteNamedInstance)

2016-06-24 Thread Denis Magda
Please provide full thread dumps from all the nodes at the time it happens again. In particular I’m interested in what is going with the thread named "ipc-shmem-gc”. In addition to the thread dumps attache the logs from all the nodes for investigation. As a workaround you can disable shmem as

Correlated Subquery Performance

2016-06-24 Thread bearrito
First off I recognize this is probably more of an H2 issue than ignite but I'm asking her in hopes someone has seen similar behavior I have Partitioned cache on which I'm trying to run the following query. Keys are collocated based on the internalRobotName My target query is: "SELECT S1.* FROM

Re: System.exit() not exiting cleanly (locked on IgnitionEx$IgniteNamedInstance)

2016-06-24 Thread bintisepaha
JDK 1.7, 16 node cluster, each JVM 10 GB heap and 4 GB off heap. 4 nodes run on 4 linux boxes, each box has 64 GB memory. the heap is under-utilized when this happens. so doubt GC will cause it. multiple clients connect to it. clients cannot exit properly either with System.exit() or

Re: Enable Binary Reflective Serializer in the app.config

2016-06-24 Thread Pavel Tupitsyn
The workaround is to implement raw mode manually via IBinarizable interface. It will look like this for the OrderEntity class (field order should be the same in read and write methods): public void WriteBinary(IBinaryWriter writer) { var w = writer.GetRawWriter(); w.WriteInt(OrderId);

Re: Enable Binary Reflective Serializer in the app.config

2016-06-24 Thread Pavel Tupitsyn
I've reproduced it. There is a bug with DateTime in raw mode. It works when I remove OrderEntity.OrderDateTime property. Bug is filed and will be fixed shortly: https://issues.apache.org/jira/browse/IGNITE-3364 On Fri, Jun 24, 2016 at 2:15 PM, mrinalkamboj wrote: >

Re: DataStreamer pool

2016-06-24 Thread Denis Magda
Hi Dmitriy, I would simply start the streaming in a separate thread right after the compute task is received. If you need to send a result to the compute task’s originator after the streaming has finished you can use Ignite Continuation functionality releasing a thread from the public pool

Re: Enable Binary Reflective Serializer in the app.config

2016-06-24 Thread mrinalkamboj
On enabling the rawMode="true", as suggested in the configuration file, following piece of code leads to the exception: using (var ldr = ignite.GetDataStreamer("OrderCache")) { ldr.PerNodeBufferSize = 1024; //ldr.AllowOverwrite =

Re: Plug in custom binary serializer for Ignite.Net

2016-06-24 Thread mrinalkamboj
Thanks, I understood the essence, there is an example on same page which confused me, which get the RawWriter / RawReader within the WriteBinary / ReadBinary methods of the IBinarizable interface, my understanding was, that's where I would

Re: System.exit() not exiting cleanly (locked on IgnitionEx$IgniteNamedInstance)

2016-06-24 Thread AndreyVel
Coul you tell more detail how reproduce issue. What OS and java version used. How many memory has OS and how many used. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/System-exit-not-exiting-cleanly-locked-on-IgnitionEx-IgniteNamedInstance-tp5814p5870.html

RE: Jetty configuration for adding new Handler

2016-06-24 Thread Saurabh Sharma
Hi, Could anyone please tell us how to add response header "Access-Control-Allow-Origin" in the response returned from the rest call to ignite. Thanks, Saurabh From: Saurabh Sharma [mailto:saurabh.sha...@nviz.com] Sent: Thursday, June 23, 2016 7:46 PM To: user@ignite.apache.org Subject: Jetty

Re: Can I get a better performance on BinaryMarshaller?

2016-06-24 Thread Vladimir Ozerov
Hi Lin, If you cannot change source code of classes, then you can use *BinarySerializer* interface. You can implement it and then assign with particular class using *BinaryTypeConfiguration*. Vladimir. On Fri, Jun 24, 2016 at 12:24 PM, Lin wrote: > Hi Vladimir, > > I got it,

Re: Can I get a better performance on BinaryMarshaller?

2016-06-24 Thread Lin
Hi Vladimir, I got it, thank you for your fast reply. There are some third party jar files without source code, so we can't implementing the Binarylizable interface directly. Thanks again. Lin. -- Original -- From: "Vladimir

Re: Plug in custom binary serializer for Ignite.Net

2016-06-24 Thread Pavel Tupitsyn
Ignite picks a serializer the following way: * There is a non-null BinaryTypeConfiguration.Serializer => pick it * There is a non-null BinaryConfiguration.DefaultSerializer => pick it * User type implements IBinarizable => pick internal BinarizableSerializer, which just delegates to

Re: Ignite support for .net and Java

2016-06-24 Thread Pavel Tupitsyn
Hi, this is a known issue ([1], [2]), will be fixed in the next release. [1] https://issues.apache.org/jira/browse/IGNITE-3267 [2] http://stackoverflow.com/questions/37677707/failed-to-start-manager-gridmanageradapter-in-apache-ignite-net/ On Fri, Jun 24, 2016 at 7:01 AM, gaurangpatelng

Re: transaction not timing out

2016-06-24 Thread Dmitriy Setrakyan
On Thu, Jun 23, 2016 at 10:39 PM, Denis Magda wrote: > Hi Binti, > > Probably the issue is related to the fact that you’re working with the > cache inside of CacheStore.writeAll method. Have you tried to use > PESSIMISTIC/REPEATABLE_READ mode? Is the situation the same?

Re: Plug in custom binary serializer for Ignite.Net

2016-06-24 Thread mrinalkamboj
My code is based on the details on the following link: https://apacheignite-net.readme.io/docs/serialization Here the Address entity implements IBinarizable interface Can you please confirm that understanding of the document is not correct, or I am missing some part I am just implementing the

DataStreamer pool

2016-06-24 Thread Dmitry Karachentsev
Hi igniters! Using data streamer from compute tasks may cause starvation, because both operations are executed in the same public pool. Is it possible to add configuration for separate thread pool for data streamer? Thanks! Dmitry.