RE: webconsole generated project - cache load performance

2018-10-15 Thread Stanislav Lukyanov
Yep, that sounds right. The primary ways to load data into Ignite from another source are a custom cache store or a data streamer. Data streamer will mostly outperform cache stores for initial/periodic data loading. Cache stores are good when you need to sync data between Ignite and backing DB

Re: Ignite as Hibernate L2 Cache

2018-10-15 Thread scottmf
hi, I have committed my hibernate-5.2 code to a local repo in github and filed a jira ticket https://issues.apache.org/jira/browse/IGNITE-9893 repo -> https://github.com/scottmf/ignite -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: 'Deploy' ignite cluster into a spark cluster

2018-10-15 Thread Stanislav Lukyanov
Well… I mean, if you really want to… :) The issue is that spark may start or stop its executors as it sees fit – or, at least, not taking Ignite’s lifecycle into account. If an executor dies, the Ignite node dies. It doesn’t always lead to data loss, but it does lead to topology changes and

RE: 'Deploy' ignite cluster into a spark cluster

2018-10-15 Thread mamaco
Hi Stan, 'executor die, that leads ignite cluster rebalance', I haven't expected this before. Our solution is strange, it's a bit like borrowing spark job scheduling API to deploy ignite and other platforms, so, how to persuade them work together is the major consideration, below is my plan, will

RE: 'Deploy' ignite cluster into a spark cluster

2018-10-15 Thread mamaco
Hi Stan, Thank you for providing the information. Yes, it's exact 'embedded deployment', but it looks like to be deprecated because of performance issues. Stanislav Lukyanov wrote > Embedded Mode Deprecation > Embedded mode implies starting Ignite server nodes within Spark executors > which can

RE: Ignite as Hibernate L2 Cache

2018-10-15 Thread Stanislav Lukyanov
Hi, If you’d like to contribute (that’s great!) please follow this process: https://ignite.apache.org/community/contribute.html In short, you need to introduce yourself as a contributor on d...@ignite.apache.org, create a pull request on GitHub, run tests and request a review. Good luck! Stan

Re: odbc caches - cannot browse

2018-10-15 Thread wt
here is the log file generated when opening a new odbc connection to ignite in excel. odbc3.log -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Duplicate Table Error

2018-10-15 Thread Ilya Kasnacheev
Hello! I don't think you need both queryEntities and indexedTypes at the same time (and there's probably a problem in your queryEntities too). Regards, -- Ilya Kasnacheev пт, 12 окт. 2018 г. в 20:45, Skollur : > Getting an error Duplicate table name > [cache=CustomerCache,tblName=CUSTOMER, >

Re: Delay queue or similar?

2018-10-15 Thread Ilya Kasnacheev
Hello! You could have secondary (SQL) index on time, and do SELECT ORDER BY time to get most eager hosts. For initial time, you could 0L as default value. I.e. check for null => use 0L if null. Regards, -- Ilya Kasnacheev чт, 11 окт. 2018 г. в 0:20, matt : > Thanks for the feedback, Ilya!

.net Datetime loads without error but table empty

2018-10-15 Thread wt
Running into an issue where i have an underlying sql server with a DateTime field. That is loaded into a class that has DateTime field in .net. I set the class field to its value like this from the data reader value = dataReader.GetDateTime(ordinal); the load code uses GetDataStreamer and

RE: data streamer - failed to update keys (GUID)

2018-10-15 Thread wt
please ignore this thread - i have found the problem and it was some old residual test code that was being called instead. Correcting that has resolved the issue. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Writing binary [] to ignite via memcache binary protocol

2018-10-15 Thread Michael Fong
Hi, I kind of able to reproduce it with a small python script import pylibmc client = pylibmc.Client (["127.0.0.1:11211"], binary=True) ##abc val = "abcd".decode("hex") client.set("pyBin1", val) print "val decode w/ iso-8859-1: %s" % val.encode("hex") get_val = client.get("pyBin1") print

Re: Persistence store data not getting distributed across files on different machine in cluster

2018-10-15 Thread Maxim.Pudov
Looks like you baseline topology (nodes used for persistence) contains only 1 node. Have you tried adding other nodes to the baseline topology? Please follow this guide https://apacheignite.readme.io/docs/baseline-topology#section--add-nodes-to-the-topology to do so. -- Sent from:

RE: .net Datetime loads without error but table empty

2018-10-15 Thread Stanislav Lukyanov
Actually… Do you create the cache with `CREATE TABLE`? How do you create objects to pass to the data streamer? Most likely, you’re using some .Net type for the timestamp which doesn’t map correctly to the java.sql.Timestamp. And Ignite will expect the java.sql.Timestamp when you create it as a

RE: .net Datetime loads without error but table empty

2018-10-15 Thread wt
this is sorted now thanks Stan - >net has several ways to do it and it didn't seem to like the other ways i was trying. simply setting it to datetime.touniversaltime resolved it. I do however think it odd that ignite was not throwing any errors -- Sent from:

RE: .net Datetime loads without error but table empty

2018-10-15 Thread Stanislav Lukyanov
A guess: the value is being saved, but due to an issue with name or type matching in the QueryEntity SQL engine doesn’t return it. Look for the problem in the cache config (queryEntities property), pay attention to the names, etc. Stan From: wt Sent: 15 октября 2018 г. 12:47 To:

Priority on affinityCalls

2018-10-15 Thread chewie
Hello and thank you for this project. It's awesome! I'm adapting an older DB-centric application to use Ignite in order to be more scalable and I'm trying to make my affinityCalls work in a prioritized order but can't really work it out. There seems to be a bit of documentation on Job Scheduling

Re: odbc caches - cannot browse

2018-10-15 Thread Igor Sapego
It looks like an error. I filed a ticket [1]. I'll try to fit to to 2.7 [1] - https://issues.apache.org/jira/browse/IGNITE-9891 Best Regards, Igor On Mon, Oct 15, 2018 at 10:46 AM wt wrote: > here is the log file generated when opening a new odbc connection to ignite > in excel. > >

RE: 'Deploy' ignite cluster into a spark cluster

2018-10-15 Thread Stanislav Lukyanov
Hi, Sorry, I didn’t really get what you mean here… Can you explain: - What exactly you’re doing? - How is it different from normal Ignite-Spark integration, e.g. from shared deployment (https://apacheignite-fs.readme.io/docs/installation-deployment)? - What would be an alternative solution

RE: Priority on affinityCalls

2018-10-15 Thread Stanislav Lukyanov
Hi, Nope, there is no priority queue for affinity calls. ComputeTaskSplitAdapter seems to be the best way to handle this. As an alternative, you could do something similar with a cluster singleton service: submit tasks to it, sort by priority, and send them to the servers as affinityRun. Not