'Deploy' ignite cluster into a spark cluster

When I implement a Spark streaming project, I involuntarily found Ignite could be easily hacked into spark yarn cluster and work on the spark datanodes as an additional ignite cluster(use spark cluster resources, RAM,core without complex deployment), and all data process could be done with

Duplicate Table Error

Getting an error Duplicate table name [cache=CustomerCache,tblName=CUSTOMER, type1=Customer, type2=Customer] when i tried to add index as below ccfg.setIndexedTypes(Long.class,Customer.class); public class Customer implements Serializable { /** Value for dwId. */ @QuerySqlField(index =

Re: Ignite on Spring Boot 2.0

I found a way to solve this issue.. thank you so much for your help ... On Fri, Oct 12, 2018 at 9:24 AM ignite_user2016 wrote: > yes agree it is trivial but my ignite configuration stays in XML files so I > would have to pull that XML configuration in code.. > > I am still wondering why this

RE: Thin client vs client node performance in Spark

On your questions > 1) How does one increase write throuput without increasing number of clients > (the server nodes are underutilized at the moment) Actually, adding more clients is the supposed way of increasing throughput if servers have capacity. > 2) We have use cases where we many have

RE: unable to create indexing on dataframe

Hi, If you want help, you have to explain what is your problem. Sharing code is great, but people also need to understand what exactly you’re trying to do and what to look for. Also, your code seems to contain private classes (com.inn.*) so no one will be able to run it anyway. Stan From:

Re: client probe cache metadata

thanks for the help on this Stan -i will look into that method. thanks -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: client probe cache metadata

i need to to be able to discover what each cache configuration is. It this system is to have a large number of tables we need a way to identify what the original configuration for the given cache is. All our configs are happening at runtime (no xml file) because we are moving in a direction of

RE: Spark Dataframe write is hanging

Hi, Were you able to find the root cause of this? If yes, what was it? The error indicates a network connection issue, so I guess the solution should be about the network configuration. Stan From: eugene miretsky Sent: 21 августа 2018 г. 23:35 To: user@ignite.apache.org Subject: Spark

RE: data streamer - failed to update keys (GUID)

There is an error “Failed to update index, incorrect key class”. Any chance you’ve changed an integer field to a string one, or something like that? using (var ldr = igniteclient.GetDataStreamer(TableName)) = works using (var ldr = igniteclient.GetDataStreamer(TableName)) = fails shown error

RE: Remote Listen Events are available in C#.Net

Nope. Here is the JIRA to add that: https://issues.apache.org/jira/browse/IGNITE-1683. Seems like the functionality was broken at some point, and because of that it was removed from Ignite. Someone needs to address that and bring the API back to C#. Stan From: Hemasundara Rao Sent: 12 октября

Re: YCSB Benchmark

Hi, Did you try to run Cassandra on the same YCSB/Cassandra configuration? вс, 30 сент. 2018 г. в 16:23, Shay Alon : > Hi, > > Can someone can help here? > > > > On Sat, Sep 22, 2018 at 9:39 AM Shay Alon wrote: > >> Hi, >> >> 1. Yes I'm running Ignite and YCSB nodes on the same machine and

RE: Ignite on Spring Boot 2.0

yes agree it is trivial but my ignite configuration stays in XML files so I would have to pull that XML configuration in code.. I am still wondering why this piece of code stopped working ? if (cfgPath != null && cfg != null) { throw new IllegalArgumentException("Both

RE: data streamer - failed to update keys (GUID)

There is an error “Failed to update index, incorrect key class”. Any chance you’ve changed an integer field to a string one, or something like that? Changing field types is generally not supported. Stan From: wt Sent: 12 октября 2018 г. 14:06 To: user@ignite.apache.org Subject: RE: data

RE: data streamer - failed to update keys (GUID)

not sure if it is related but the error isn;t pointing to it being an issue. interop requires uct date and from sql server we are parsing in a datetimeoffset and ignite sees it as an object and not timestamp -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: data streamer - failed to update keys (GUID)

I get the same error when trying the key as a string. here are some screen shots of the code, error, and table structure table_stucture.png code.png

Re: How to use BinaryObject Cache API to query a table created from JDBC?

Hi, Try the next example and follow the same way for your: // Open the JDBC connection. try { Connection conn = DriverManager.getConnection("jdbc:ignite:thin://127.0.0.1;user=user;password=password"); //remove user password if you don't have security

RE: data streamer - failed to update keys (GUID)

Yes, there is a direct support for UUID. If you don’t know where the error is coming from, please share the code and the logs. Stan From: wt Sent: 12 октября 2018 г. 13:00 To: user@ignite.apache.org Subject: data streamer - failed to update keys (GUID) hi I just wanted to check something. I

RE: Query 3x slower with index

Yes, sure. From: Dave Harvey Sent: 11 октября 2018 г. 23:59 To: user@ignite.apache.org Subject: Re: Query 3x slower with index "Ignite will only use one index per table" I assume you mean "Ignite will only use one index per table per query"? On Thu, Oct 11, 2018 at 1:55 PM Stanislav Lukyanov

RE: Role of H2 datbase in Apache Ignite

No, that one actually impacts how indexes are built, which is Ignite’s domain. queryParallellism is the number of index trees that are created by Ignite. In terms of Ignite-H2 communication, queryParallelism=N means that Ignite will send N parallel queries to H2, each using a different index

Re: Query 3x slower with index

having worked with databases for 20 years i can see your indexes are not fully scoped. i see this as your issue having SUM(product_views_app) > 2 OR SUM(product_clicks_app) > 1 add those columns to the composite index so that it doesn't need to access the underlying table and can just use the

data streamer - failed to update keys (GUID)

hi I just wanted to check something. I have a table that has a guid key. When i try insert into this table at the end of the insert when the data reader connection closes i get this error (i have included a select that shows there is just 1 record with that key). Can Ignite handle guid keys?

How to use BinaryObject Cache API to query a table created from JDBC?

Let's say I create a table from jdbc client using this command. create table test(a varchar, b varchar, c varchar,primary key(a,b)); I inserted one record in this table. select * from test; ++++ |

Re: Ignite Events

Hi Ivan, thank you so much for your explanation! In fact it was a bit tricky, but now I understand what's going on. I'm currently using Ignite 2.4. Bets regards Davide -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Persistence store data not getting distributed across files on different machine in cluster

Thanks Maxim. I have CLEARED various directories Work/WalStore/IgnitePersistentStore and WalArchive on all the nodes and starting the cluster in clean state. After this I can see that nodes have been created using node00_uuid format. BUT cache data is still not getting partitioned across