Re: NPE exception in KMeansTrainer

Also, is there any ways to workaround this issue in 2.6 to make it works? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Data index loss problem

Recently discovered a problem, don't know what the reason, one of the data in the Table a Long field with the Select * from Table where nameid = value when the query data, but the use of Select * from Table where nameid like '% value can find data, prove the existence of the data is the data, but

Re: Failed to map keys for cache (all partition nodes left the grid)

Hello, Does baseline topology include both of your server nodes? 2018-08-21 3:32 GMT+03:00 scottmf : > Hi, I'm seeing the errors below in my ignite cluster. This occurs > consistently in my env when I apply a "rolling upgrade" where I take down > one node at a time by updating them with a new

Re: NPE exception in KMeansTrainer

@zaleslaw I have a Map> where outer map is userId -> hitsMap and inner hitsMap is domain -> hits. So I need to do domain vectors for each of the user. Cache populated through Cache.put operation. private Map> hits; <...> storageName = "profile-clustering-" + LocalDateTime.now();

Re: Ignite.NET how to cancel tasks

Hello Maksym, Sorry for the delay. I'll try the modified example. I am not an expert in C#/.Net, so I cannot guarantee that the following topic will be helpful, but please take a look at https://apacheignite-net.readme.io/v2.6/docs/asynchronous-support#section-async-continuations Thanks, S.

Query execution too slow

Hi, Following SQL is taking too long to execute. It seems that highlighted condition is not using indexes. I have created the indexes as follows. What should be done to makes use of index created on value column/property? Can someone please advise? public class DnsNetBiosAssetGroupData

Re: Apache Ignite SQL- read Only User Creation

Hi, I believe that you said about https://apacheignite.readme.io/docs/advanced-security It will provide the possibility to create/drop/alter the users. Also, it provides the only simple authentification with the password. You can't set the rules like read-only using it. Also, you can try to

Ignite Indexes

Hi, I have gone through this link , but still have some doubts. Please check the following example. public class TestData @QuerySqlField private long id; @QuerySqlField(orderedGroups =

Re: ignite.net config (applying spring and .net config)

Hello! Here's the sample snippet: var cfg = new IgniteConfiguration() { SpringConfigUrl = "ignite-config.xml", BinaryConfiguration = new BinaryConfiguration

Data modeling for segmenting a huge data set: precomputing vs real time computations

Hello, We have a very big data set (200M+ users), for each user we store their activity (views, sales, etc.) and we need to be able to segment the users based on that data. One (very simplified) use case looks something like: - Data: customer_id, date, category, sub_category, action - Query: All

Re: ignite.net config (applying spring and .net config)

Brilliant thanks a million Ilya. pts working with the plugin -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Query execution too slow

Hello! Can you please show the original query that you are running? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite and Persistent Collections

Will do thanks -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Failed to map keys for cache (all partition nodes left the grid)

Hi Alex,Yes, the baseline topology contains both the server nodes and the client node. Everything is looks as I would expect including the IP addresses. A couple more notes: when the nodes get restarted the IP addresses will disappear from the baseline topology, then will come back. The IP

Re: Query execution too slow

Hi, Thank you for pointing out the mistake. After changing the order to 1 as follows, SQL executed quickly. public class DnsNetBiosAssetGroupData implements Data,UpdatableData { @QuerySqlField private long id; @QuerySqlField(orderedGroups = {@QuerySqlField.Group(name =

Slow SQL query uses only a single CPU

Hi, We have a cache called GAL3EC1, it has 1. A composite pKey consisting of customer_id and date 2. An Index on the date column 3. 300 sparse columns We are running a single EC2 4x8xlarge node. The following query takes 8min to finish Select COUNT (*) FROM (SELECT customer_id FROM

Re: Affinity key in SQL execution

There are several ways to do this. First one is shown in your first message - DefaultDataAffinityKey instance plays the role of primary key, while enclosed affinityId field plays the of affinity key, because it's annotated with @AffinityKeyMapped. In case you don't have classes at all and

Re: Slow SQL query uses only a single CPU

Here is the result of EXPLAIN for the afermantioned query: SELECT __Z0.CUSTOMER_ID AS __C0_0, SUM(__Z0.EC1_BKNT_TOTAL_PRODUCT_VIEWS_APP) AS __C0_1, MAX(__Z0.EC1_HNK_TOTAL_PRODUCT_CLICKS_APP) AS __C0_2 FROM PUBLIC.GAL3EC1 __Z0 /* PUBLIC.DT_IDX: DT > '2018-05-12' */ WHERE __Z0.DT > '2018-05-12'

Re: Affinity key in SQL execution

I could not find any cache config setting where one can provide the primary key column name or affinity column name of a given cache. How does ignite identify that column provided in select query's where clause is a primary key or affinity key? Can you give an example? Thanks, Prasad On Wed,

Recommended HW on AWS EC2 - vertical vs horizontal scaling

Hello, We are looking to set up a fairly large (a few TB) cluster in AWS for OLAP and transactional use cases. 1. Are there any Ignite benchmarks on horizontally vs vertical scaling? 2. What EC2 instances are other people using in prod? (I am assuming that one of the memory optimized

Re: Affinity key in SQL execution

I am still not getting it. The field affinityId in my data key is just like any other field which hold the value of affinity key column. For cache1 it will hold subscriptionId and for other cache it might hold value of some other affinity key. But when I write SQL like 'select * from Cahce_1

Re: Configurations precedence and consistency across the cluster

Hello, 1. No. Cache with configuration specified in xml file will be pre-created and won't change if you will try to get it using changed configuration. 2. If you are asking about a single node, yes, that is correct. 3. You will get an exception on startup in case you have different

Re: Affinity key in SQL execution

Prasad, Affinity key is always a part of primary key. For example, in your case primary key consists of two fields - id and subscriptionId. Therefore you can query by primary key without providing the affinity key. On the other hand, however, query can be routed to a single node even if only

Loading Cache

Currently I am loading data with one line in java. Below ocmmand will load all data from database to Cache. Example: ignite.cache("CustomerCache").loadCache(null); I would like to load data for specific period. How would I do that? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Affinity key in SQL execution

Hi, I am using key value store and I have configured multiple caches. These caches have different affinity key. To store the values in cache I am using following key. Id and affinityId column can be different for different caches. public class DefaultDataAffinityKey implements DataKey {

Re: Failed to map keys for cache (all partition nodes left the grid)

Hi, Do you see the same exception for a REPLICATED cache? And this exception also appears in two node setup with backups = 1, when you simply shut down one node, is that correct? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Spark Dataframe write is hanging

Hi, When I am saving Spark Dataframe to Ignite, the job sometimes get stuck with the attached error. It seems to happen at random, and usualy at the end of the job (all the data has already been writen to Ignite) Has anybody encountered this before? java.net.ConnectException: Connection

Re: Failed to map keys for cache (all partition nodes left the grid)

This also occurs when I simply restart one of the ignite nodes without changing the IP address. It has nothing to do with the upgrade process. Here is my cacheconfiguration: CacheConfiguration configuration = new CacheConfiguration<>();configuration.setStatisticsEnabled(true);

Re: Query execution too slow

Hello! Yes, I am afraid that you will need another index. Regards, -- Ilya Kasnacheev 2018-08-21 19:55 GMT+03:00 Prasad Bhalerao : > Hi, > > Thank you for pointing out the mistake. > After changing the order to 1 as follows, SQL executed quickly. > > public class DnsNetBiosAssetGroupData

Re: Loading Cache

Hi, Call a method like this and pass closure that returns true for data entries that match your criteria in apply() method: cache.loadCache(new P2() { @Override public boolean apply(Integer key, String val) { // Accept only even numbers. return key % 2 == 0; } },

Re: Failed to map keys for cache (all partition nodes left the grid)

Yes that is correct. I see the same exceptions when the cache is REPLICATED with backups = 1 in my two node cluster. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Failed to map keys for cache (all partition nodes left the grid)

hi Alex,Sorry for the confusing comment. My baseline topology does not have a client node. I was indeed referring to the current cluster topology in my previous comment. These ignite cluster nodes are programmed to come up and immediately run ignite.cluster.active(true) but that is not

Re: Failed to map keys for cache (all partition nodes left the grid)

hi Alex, That was it. I read a little deeper into the doc and I wasn't setting the baseline topology. I think I had it in my head that ignite.cluster().active(true) set the topology. I see now that was incorrect. I just tested it and I'm good. thanks a lot!! -- Sent from:

Re: Failed to map keys for cache (all partition nodes left the grid)

I think you are confusing the "current cluster topology" and the "baseline topology" terms. Baseline topology cannot contain client nodes. Current baseline topology can be printed or changed by "control.sh" script. You can read more about baseline topology here: [1] [1]:

Re: Query execution too slow

Hi, Composite index field order matters. Try to set order=3 for "value" column. On Tue, Aug 21, 2018 at 10:43 PM Ilya Kasnacheev wrote: > Hello! > > Yes, I am afraid that you will need another index. > > Regards, > > -- > Ilya Kasnacheev > > 2018-08-21 19:55 GMT+03:00 Prasad Bhalerao : > >>

Re: Failed to map keys for cache (all partition nodes left the grid)

Yes that is correct. I see the same exceptions when the cache is REPLICATED with backups = 1 in my two node cluster. On Tue, Aug 21, 2018 at 12:37 PM akurbanov wrote: > Hi, > > Do you see the same exception for a REPLICATED cache? > And this exception also appears in two node setup with

Re: Apache Ignite SQL- read Only User Creation

Thanks Andrei, I ceated user but can't alter user except for changing password, The user is able to delete rows or truncate tables which I dont want except ignite user. Thanks -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Query execution too slow

Original Sql query: SELECT dnsnb.value, dnsnb.id FROM DnsNetBiosAssetGroupData dnsnb JOIN TABLE (value VARCHAR = ? ) temp ON dnsnb.value = temp.value WHERE dnsnb.subscriptionId = ? AND dnsnb.assetGroupId = ? AND dnsnb.assetTypeInd = ? temp table list has around 1_00_000

Re: Query execution too slow

Hello! I think that value should have order of 1 to be used here. Can you try that? Regards, -- Ilya Kasnacheev 2018-08-21 18:56 GMT+03:00 Prasad Bhalerao : > Original Sql query: > > SELECT dnsnb.value, > dnsnb.id > FROM DnsNetBiosAssetGroupData dnsnb > JOIN TABLE (value VARCHAR = ? )

Re: Ignite Indexes

Hello! Regarding index order: Index order basically means that records in the data_idx1 index will be sorted by field1; if two records have the same field1 value, field3 will be used as sorting tier, and if both field1 and field3 are same, field2 will be used as sorting tier. Index is basically

Re: REST service command LOG

Log command of the REST API provides access just for logs of the node where the service raised. Logs can be retrieved from IGNITE_HOME/ or from the path defined in the log configuration of the node. Log configuration should be defined expliciltly when Ignite-log4j module is enabled. XML:

ignite.net config (applying spring and .net config)

Hi I am trying to work out if i can start ignite using the spring config but then register a custom .net plugin through .net but i can't find any documentation on how this can be done apart from this section from the following documentation (see in bold for the specific reference to this)

Re: Ignite and Persistent Collections

Hello! My recommendation is to re-send this question to developer list, since it concerns design considerations and not already shipped features. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Configurations precedence and consistency across the cluster

Hello, It looks like there are several ways to set cluster configuration (I am currently looking at CacheConfiguration in particualr) 1. Via the configuration XML file provided at startup 2. Via the Java client (CacheConfiguration object) 3. Via SQL commands I have a few questions