Re: Ignite WebSessionFilter client threads eating up CPU usage

2019-05-20 Thread wbyeh
Ilya ,After we switched build-in openJDK (jdk-8u181-ojdkbuild-linux-x64) to Zulu JDK (zulu8.38.0.13-ca-jdk8.0.212-linux_x64), it still has a high loading CPU usage.And we found the linux node has a low CPU frequency than other nodes w/ same configurations on CentOS 7.5.

Re: Recommended way of random sampling

2019-05-20 Thread Ilya Kasnacheev
Hello! You can have a random indexed field in your table and do queries like SELECT * FROM table WHERE rand_field < RAND() LIMIT 1; to sample random item. Regards, -- Ilya Kasnacheev пн, 20 мая 2019 г. в 04:50, Stéphane Thibaud : > As a small addition: it would really help if Ignite had a

Re: SQL API in C++ thin client

2019-05-20 Thread Ilya Kasnacheev
Hello! Why don't you use ODBC? ODBC is a native C++ SQL API and Ignite supports it. Regards, -- Ilya Kasnacheev вс, 19 мая 2019 г. в 16:38, matanlevy : > Thanks. > I saw now this JIRA item > https://issues.apache.org/jira/browse/IGNITE-9109 >

Re: Multithreading using pyignite

2019-05-20 Thread Ilya Kasnacheev
Hello! I guess the recommendation here is to create a new client in every thread where you need them. Regards, -- Ilya Kasnacheev вс, 19 мая 2019 г. в 08:39, Stéphane Thibaud : > Hello Ignite users, > > I am wondering whether the pyignite library is thread-safe. I get strange > errors when I

Re: Ignite with Hibernate 5.3

2019-05-20 Thread Ilya Kasnacheev
Hello! There are no solid plans to release 2.8.0. Your best bet is probably trying to backport and build this module from master. Regards, -- Ilya Kasnacheev ср, 8 мая 2019 г. в 18:59, Tomasz Prus : > When it will be released? > > > On 8 May 2019, at 15:29, Vladimir Pligin wrote: > > > >

Re: Recommended way of random sampling

2019-05-20 Thread Stéphane Thibaud
Excuse me, I just sent my response, but I see that you actually suggested a new column... in that case this would work, but I think it's a bit unfortunate to have to store random numbers. Kind regards, Stéphane Thibaud 2019年5月20日(月) 19:22 Stéphane Thibaud : > Hello Ilya, > > Thank you for

Re: Recommended way of random sampling

2019-05-20 Thread Ilya Kasnacheev
Hello! I'm not sure why you think it will not scale. If this field is indexed then taking a random sample is basically one b-tree walk away. I guess you will have to store random numbers, if you rely on non-random field it might introduce bias. Regards, -- Ilya Kasnacheev пн, 20 мая 2019 г.

Re: Multithreading using pyignite

2019-05-20 Thread Stéphane Thibaud
Great. Thank you. I went with an awesome pip package called 'resource-pool'. Kind regards, Stéphane Thibaud 2019年5月20日(月) 15:44 Ilya Kasnacheev : > Hello! > > I guess the recommendation here is to create a new client in every thread > where you need them. > > Regards, > -- > Ilya Kasnacheev >

Re: Recommended way of random sampling

2019-05-20 Thread Stéphane Thibaud
Hello Ilya, Yes, you are right. I sent my first response too quickly. With an extra column it will work. I will go with the approach you suggest. :-) Kind regards, Stéphane Thibaud 2019年5月20日(月) 20:26 Ilya Kasnacheev : > Hello! > > I'm not sure why you think it will not scale. If this field

Re: Recommended way of random sampling

2019-05-20 Thread Stéphane Thibaud
Hello Ilya, Thank you for that suggestion. On a traditional database I know that approach does not scale well, since a random number is first assigned to all rows (it scales linearly with the number of rows if I am not mistaken). Do you think this would be different for Ignite? Kind regards,

Re: Issue with peerclassloading when using dataStreamers

2019-05-20 Thread Ilya Kasnacheev
Hello! Can you please share complete logs from all nodes in your cluster? Regards, -- Ilya Kasnacheev чт, 9 мая 2019 г. в 18:00, Abhishek Gupta (BLOOMBERG/ 731 LEX) < agupta...@bloomberg.net>: > I'm using datastreamers to ingest data from files into the cache. I've a > need to do an

Re: count not updated through SQL using DataStreamer

2019-05-20 Thread Ilya Kasnacheev
Hello! Can you show how you create FOO table? I guess expected cache type is NOT , that's why no data is seen. Regards, -- Ilya Kasnacheev чт, 16 мая 2019 г. в 23:49, Banias H : > Hello Ignite experts, > > I am very new to Ignite. I am trying to ingest 15M rows of data using > DataStreamer

Re: Certificate upgrade in Ignite Cluster

2019-05-20 Thread Ilya Kasnacheev
Hello! Can your new certificate be read with your existing trust store? If it can, you can just stop nodes one by one, bring them back with revised certificate. If it can't, first you have to push trust store to all nodes in the same fashion, which will contain trusts for both new and old

Re: Re:Re:RE: Re: Node can not join cluster

2019-05-20 Thread Vishalan
What was the solution to above problem.I am facing the same issue -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite WebSessionFilter client threads eating up CPU usage

2019-05-20 Thread Ilya Kasnacheev
Hello! I can only guess that maybe your Web Sessions are very large so there are performance implications. Can you make sure you don't hold bulky objects in Sessions? Regards, -- Ilya Kasnacheev вт, 14 мая 2019 г. в 10:43, wbyeh : > We are using Ignite 2.7 as a 4-server-node session cluster

Re: C++ Thin Client Lacks PC File

2019-05-20 Thread mwilliamso58
bump -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Trouble with continuous queries

2019-05-20 Thread Mike Needham
Hi All, I have a cache that is running and is defined as IgniteCache exchCache = ignite.getOrCreateCache(new CacheConfiguration<>("EXCHANGE") .setIndexedTypes(Long.class, Exchange.class) .setAtomicityMode(CacheAtomicityMode.ATOMIC) .setBackups(0)

Native Client/Full Python API

2019-05-20 Thread mfrey
Hello, Is there a plan to release the native client API for Python (like the Java, .Net and C++ ones) ? I am not talking about the thin client here. I am evaluating Apache Ignite for a solution with many decentralized write-backs/data imports and quite complex business calculations. i would

failed to get the security context object

2019-05-20 Thread radha jai
Hi, Please Some one reply on this. I have implemented the grid security processor and setting the securityconext holder in the authenticate function as below, public class MySecurityProcessor extends GridProcessorAdapter implements DiscoverySpiNodeAuthenticator,

Re: C++ Thin Client Lacks PC File

2019-05-20 Thread Igor Sapego
Maybe, you could start with these threads: [1], [2] [1] - https://lists.freedesktop.org/archives/pkg-config/2007-August/000218.html [2] - https://autotools.io/pkgconfig/file-format.html Best Regards, Igor On Mon, May 20, 2019 at 4:57 PM mwilliamso58 wrote: > bump > > > > -- > Sent from:

Re: The CPU of Ignite NODEs in the same cluster has 20% gap

2019-05-20 Thread Ropugg
Update the jvisualvm screenshot. --

Re: Ignite 'complex' type

2019-05-20 Thread Dmitry Melnichuk
Stéphane, I afraid this won't work. Ignite storage is typed, thus you can not use values of arbitrary type, but only of Pythonic types that defined here[1]. If you really want to store such a complex object as a whole, you can either 1) serialize it with pickle/dill/protobuf/json/et c. and

Re: Ignite 'complex' type

2019-05-20 Thread Stéphane Thibaud
Any thoughts about this one? Kind regards, Stéphane Thibaud 2019年5月16日(木) 20:55 Stéphane Thibaud : > Hello Ignite experts, > > I am trying to store a python value of type > > Tuple[Dict[str, float], bytes] > > in an Ignite cache. However, doing that without type hints I get: > > TypeError:

The CPU of Ignite NODEs in the same cluster has 20% gap

2019-05-20 Thread Ropugg
We have a cluster has 20 nodes. 18 nodes work as http servers, 2 nodes work as cache servers. The 18 nodes query data from the 2 cache servers via IgniteService and IgniteCache. But on the load testing, the CPU of 2 cache severs has 20% gap.

Re: Ignite 'complex' type

2019-05-20 Thread Stéphane Thibaud
Thank you Dmitry. I will use serialization in this case. Kind regards, Stéphane Thibaud 2019年5月21日(火) 9:01 Dmitry Melnichuk : > Stéphane, > > I afraid this won't work. Ignite storage is typed, thus you can not use > values of arbitrary type, but only of Pythonic types that defined > here[1].