Re: Future of IGFS.

2019-05-14 Thread Denis Magda
Hello Chris, IGFS was developed with the thinking that it would be a solution for Hadoop acceleration. However, it was discovered in practice that the performance benefits it gives are insignificant for production deployments. For instance, based on my experience IGFS combined with Hadoop Accelera

Re: IgniteFileSystem.create(...) Question--File Properties?

2019-05-14 Thread Denis Magda
Hello, Are you using IGFS as a standalone file system or as a way to accelerate Hadoop? If for the latter then I would suggest considering an alternate solution that is proved to be efficient for production deployment and Hadoop offloading: http://apache-ignite-users.70518.x6.nabble.com/SW-recomme

Re: SW recommendation: Ignite Native Persistence for traditional relational data warehouse?

2019-05-14 Thread Denis Magda
Hello, In short, Ignite persistence primary advantages are: - Enables multi-tiered storage across RAM and disk - 100% of data persisted to disk ("warm" and "cold" data sets) while "hot" data always stays in RAM. You lay out the data the way you need. Applications just run queries and

Metrics to get size of cache in memory

2019-05-14 Thread gupabhi
Hello, I'm looking to get memory (heap/off heap) consumed by my cache across the cluster. If possible also per node. What is the best way of doing this. Thanks, Gupabhi -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

SW recommendation: Ignite Native Persistence for traditional relational data warehouse?

2019-05-14 Thread m4mmr
Hi, I am in a project where we are building a new database with strong normalisation requirements - very much like a relational data warehouse. We source the data from HDFS. And the maintenance team requires the data movement to be implemented through SQL APIs. Main Question: Would it be a viabl

Re: Timestamp with Python thin client

2019-05-14 Thread Denis Mekhanikov
Stéphane, Could you provide the code, that results in this exception? Do you try to insert the tuple as a single field via SQL? There is no such primitive as a tuple in SQL, so you should probably split timestamp into datetime and nanoseconds columns and store them separately as two different colu

IgniteFileSystem.create(...) Question--File Properties?

2019-05-14 Thread Chris Software
Hello, I am wondering what sort of File Properties can be set in ignite using the IgniteFileSystem.create(IgfsPath path, int bufSize, boolean overwrite, int replication, long, blockSize, Map props) method. I am using the default storage. It's not obvious to me in the code what choices I have for

Re: Two DataStreamer pods for load balancing on Kubernetes

2019-05-14 Thread Denis Mekhanikov
Sheshananda, > we are not getting any logs for the 2nd pod Do you mean that the client node with the data streamer doesn't join the cluster? Or the node joins, but just doesn't receive any data from Kafka? Denis пт, 3 мая 2019 г. в 06:26, sheshananda : > HI, > > I am using DataStreamer to load

Re: Future of IGFS.

2019-05-14 Thread Chris Software
Hello! Would this question be better suited to the contributor's distro? For one thing, I have a couple of patches I would like to submit if IGFS has a future. Thank you. On Sun, May 12, 2019 at 2:54 PM Chris Software wrote: > Hello, > > I have heard a rumor that IGFS will be dropped in the f

Re: Trouble with continuous queries

2019-05-14 Thread Denis Mekhanikov
Mike, First of all, it's recommended to have a separate cache per table to avoid storing of objects of different types in the same cache. Continuous query receives all updates on the cache regardless of their type. Local listener is invoked when new events happen. Existing records can be processe

Re: sizing

2019-05-14 Thread Denis Mekhanikov
Clay, If you want to store plain strings without any schema or markup, then use varchar. But if you plan to store POJOs, then binary objects should certainly be used instead of varchar. Binary types contain meta information, improving type safety of stored data. Binary objects don't apply any com

SQL API in C++ thin client

2019-05-14 Thread matanlevy
Hi, is there any plan to add support of SQL API in C++ thin client? If yes, is it known in which version should it be supported? Thanks! -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Store raw binary value in Apache Ignite through thin python client

2019-05-14 Thread kulinskyvs
I'm trying to save some raw binary data into Apache Ignite using thin Python client and the process is very slow (actually it looks like it depends on the size of the data). For my simple test case I've started locally Ignite with single node (version 2.7.0 without any specific configuration): A

Ignite WebSessionFilter client threads eating up CPU usage

2019-05-14 Thread wbyeh
We are using Ignite 2.7 as a 4-server-node session cluster but recent weeks we found some Ignite WebSessionFilter client threads eating up CPU usage after days of running. The GC is running smoothly. How to address the root cause? Is it a Ignite 2.x known issue with StripedExecutor? Can experts