Re: 20 minute 12x throughput drop using data streamer and Ignite persistence

2018-02-13 Thread David Harvey
We are pulling in a large number of records from an RDB, and reorganizing the data so that our analytics will be much faster. I'm running Sumo, and have looked at all of the log files from all the nodes, and the only things are checkpoints and GC logs. The checkpoints are fast, and occur at a

Re: 20 minute 12x throughput drop using data streamer and Ignite persistence

2018-02-13 Thread slava.koptilin
Hi Dave, Is possible to share a code snippet which illustrates DataStreamer settings and stream receiver code? Best regards, Slava. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: 20 minute 12x throughput drop using data streamer and Ignite persistence

2018-02-13 Thread slava.koptilin
Hi Dave, Could you please provide more details about that use-case. Is it possible to reproduce the issue and gather JFR and log files from all participated nodes? It would be very helpful in order to understand the cause of that behavior. Thanks! -- Sent from:

Re: Enable Kerberos on Ignite Kafka streamer / support for new consumer config

2018-02-13 Thread Andrey Mashenkov
Hi Jackson, I can't figure out how to switch to new style config. Seem, "bootstrap.servers" option should be used instead of "zookeeper.connect". Do you mean using "bootstrap.server" option is not working for you? On Wed, Feb 7, 2018 at 1:18 PM, jackson.dickson

Re: Logging using Log4Net

2018-02-13 Thread Alexey Popov
Hi, Hm, actually, you've got several log4net misconfigurations in your solution. Everything was fine with Ignite config itself ). Please see updated minified solution attached. Just "build a solution" and it will restore all required packages. The following log4net misconfigurations fixed: 1.

Re: slow query performance against berkley db

2018-02-13 Thread Stanislav Lukyanov
Hi Rajesh, While I don't have - and, probably, no one has - any benchmarks comparing Ignite vs Berkeley in a single node configuration (as others have said, this is not really a common use case for Ignite), I can say that performance problems you see are likely to be caused by your query

Kubernetes discovery with readinessProbe

2018-02-13 Thread Bryan Rosander
We're using Apache Ignite in Kubernetes as a caching layer right now and it's working well for us so far. One thing that's been problematic is that when defining a readinessProbe, the TcpDiscoveryKubernetesIpFinder only sees pods already in a ready state. This means that if you start all your

Re: Ignite with Spring Cache on K8S, eviction problem

2018-02-13 Thread vkulichenko
Pavel, Can you please elaborate on this? What is generated by Spring and why is it not suitable for Ignite? -Val -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Write ahead log and early eviction of new elements

2018-02-13 Thread Raymond Wilson
I have a scenario I would like to validate when using Ignite Persistence. I understand when I add an element to a cache that element is serialized, placed into the local memory for the cache on that server and then placed into the WAL pending checkpointing (merging into the persistence store).

RE: Dates before epoch - java.sql.Date

2018-02-13 Thread Williams, Michael
Nevermind, I made an error, works fine. Mike From: Williams, Michael Sent: Tuesday, February 13, 2018 3:24 PM To: user@ignite.apache.org Subject: Dates before epoch - java.sql.Date If I need to store dates before the Unix epoch, should I use timestamp, as java.sql.Date doesn't store anything

Dates before epoch - java.sql.Date

2018-02-13 Thread Williams, Michael
If I need to store dates before the Unix epoch, should I use timestamp, as java.sql.Date doesn't store anything before 1970? Do date functions support timestamp as well as date? See: https://docs.oracle.com/javase/7/docs/api/java/sql/Date.html See also:

How to connect to kubernetes pods from ignite client

2018-02-13 Thread Vishwas Bm
Hi, I have setup 3 kuberentes pods each running a ignite server as per the link. My question is how to connect to these from an ignite client which is outside the kubernetes environment. I have the client running in a contianer. How does the client discover the ignite pods. Should we use the

Re: MultiMap

2018-02-13 Thread Amir Akhmedov
I'm planning to start working on this ticket in couple of days, hopefully will be implemented soon. On Feb 13, 2018 6:06 PM, "Michael André Pearce" wrote: > Hi > > I just filled out the survey from the website and it reminded me of one > short coming of Apache

Re: Dates before epoch - java.sql.Date

2018-02-13 Thread vkulichenko
Mike, Looks like you already have a solution, right? http://apache-ignite-users.70518.x6.nabble.com/RE-Dates-before-epoch-java-sql-Date-tp20034.html -Val -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

MultiMap

2018-02-13 Thread Michael André Pearce
Hi I just filled out the survey from the website and it reminded me of one short coming of Apache ignite still that we some times hit that means we occasionally have to use Hazelcast still. And that is lack of a multimap. We saw last year this JIRA but it seems to have died.

RE: Dates before epoch - java.sql.Date

2018-02-13 Thread Williams, Michael
Yep, all set. Sorry. Getting better at this, honestly. -Original Message- From: vkulichenko [mailto:valentin.kuliche...@gmail.com] Sent: Tuesday, February 13, 2018 6:07 PM To: user@ignite.apache.org Subject: Re: Dates before epoch - java.sql.Date Mike, Looks like you already have a

Re: Write ahead log and early eviction of new elements

2018-02-13 Thread Denis Magda
My guess before the entry (element) gets evicted it will be synced to a respective partition file on disk forcibly so that you can grab it from there later. Ignite persistence experts please confirm my understanding. — Denis > On Feb 13, 2018, at 1:28 PM, Raymond Wilson

Re: Logging using Log4Net

2018-02-13 Thread Alexey Popov
Igg.zip -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: 20 minute 12x throughput drop using data streamer and Ignite persistence

2018-02-13 Thread Dave Harvey
I made improvements to the statistics collection in the stream receiver, and I'm finding an excessive number of retry's of the optimistic transactions we are using. I will understand that and retry. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/