Re: IGNITE-2894 - Binary object inside of Externalizable still serialized with OptimizedMarshaller

2017-04-18 Thread Valentin Kulichenko
gument. One way is to delegate it to the > OptimizedObjectOutputStream. Second way is to extend the Objectoutputstream > in the BinaryWriterExImpl. But it is wrong way because the writeObject is > final. > > 2017-01-19 20:46 GMT+03:00 Valentin Kulichenko < > valentin.kuliche...@gmail.

Re: Spark Data Frame support in Ignite

2017-08-03 Thread Valentin Kulichenko
This JDBC integration is just a Spark data source, which means that Spark will fetch data in its local memory first, and only then apply filters, aggregations, etc. This is obviously slow and doesn't use all advantages Ignite provides. To create useful and valuable integration, we should create a

Hang when near cache is used

2017-08-03 Thread Valentin Kulichenko
Folks, One of the users reported an issue with near cache in 2.0: https://issues.apache.org/jira/browse/IGNITE-5926 There is a reproducer attached, I don't see anything obviously wrong and can reproduce the issue. Can someone take a deeper look? -Val

Re: Resurrect FairAffinityFunction

2017-08-15 Thread Valentin Kulichenko
pology state? > > On Thu, Aug 10, 2017 at 12:16 AM, Valentin Kulichenko < > valentin.kuliche...@gmail.com> wrote: > > > As far as I know, all logical caches with the same affinity function and > > node filter will end up in the same group. If that's the case, I

Re: Hibernate dialect for Ignite

2017-08-11 Thread Valentin Kulichenko
I think that's a great idea. Although I doubt anyone aver tried to use Ignite with Hibernate this way, so we need to do some testing first to identify limitations/issues we have there. -Val On Wed, Aug 9, 2017 at 12:58 PM, Dmitriy Setrakyan wrote: > Igniters, > > Given

Re: Control.sh script and cluster activation

2017-08-14 Thread Valentin Kulichenko
Agree that this is confusing. I think this functionality should be a part of Visor CLI tool (likely a new command there). -Val On Mon, Aug 14, 2017 at 4:21 PM, Denis Magda wrote: > Dmitriy, > > I see you contributed control.sh script that activates a cluster after a >

Re: Failure to deserialize simple model object

2017-08-14 Thread Valentin Kulichenko
Cross-posting to dev Folks, I'm confused by the issue discussed in this thread. Here is the scenario: - Start server node with a cache with POJO store configured. There is one type declared, read-through enabled. - Start client node and execute get() for a key that exists in underlying DB. -

Re: IgniteSemaphore methods semantics

2017-08-10 Thread Valentin Kulichenko
If this is true, I think it should be fixed. availablePermits() returning number of acquired permits sounds very confusing. -Val On Thu, Aug 10, 2017 at 7:38 AM, Andrey Kuznetsov wrote: > Hi, igniters! > > > > As IgniteSemaphore's javadoc states, > > > > "Distributed

Nightly build

2017-08-10 Thread Valentin Kulichenko
Folks, I noticed that the latest successful nightly build happened on May 31: https://builds.apache.org/view/H-L/view/Ignite/job/Ignite-nightly/lastSuccessfulBuild/ Looks like it's failing since then. Does anyone know the reason? -Val

Re: Spark Data Frame support in Ignite

2017-08-10 Thread Valentin Kulichenko
gnite-dataframes> > > — > Denis > > > On Aug 4, 2017, at 3:41 PM, Dmitriy Setrakyan <d...@gridgain.com> wrote: > > > > On Thu, Aug 3, 2017 at 9:04 PM, Valentin Kulichenko < > > valentin.kuliche...@gmail.com> wrote: > > > >> This JD

Re: SQL usability issues

2017-08-16 Thread Valentin Kulichenko
Denis, I think this article should be more generic, describing how to connect a generic JDBC tool to Ignite (probably using DBeaver as an example). Right now it looks like out of all such tools we support only DBeaver for some reason :) What do you think? -Val On Wed, Aug 16, 2017 at 1:49 PM,

Re: It seems WebSession's removeAttribute does not support HttpSessionBindingListener

2017-07-07 Thread Valentin Kulichenko
What is your Jira ID? I will add you as a contributor. -Val On Fri, Jul 7, 2017 at 2:44 PM, Valentin Kulichenko < valentin.kuliche...@gmail.com> wrote: > This will not work. WebSessionV2 does not reinvent the wheel, it provides > additional functionality. In particular, allows to

Re: It seems WebSession's removeAttribute does not support HttpSessionBindingListener

2017-07-07 Thread Valentin Kulichenko
This will not work. WebSessionV2 does not reinvent the wheel, it provides additional functionality. In particular, allows to use the same session in a clustered environment. Genuine session is local, so if you just rely on it, all session data will be lost when server that holds this session

Re: Changing public IgniteCompute API to improve changes in 5037 ticket

2017-07-12 Thread Valentin Kulichenko
Hi Max, This ticket doesn't assume any API changes, it's about broken functionality. I would start with checking what tests we have for @AffinityKeyMapped and creating missing one. From what I understand functionality is broken completely or almost completely, so I guess testing coverage is very

Re: [VOTE] Apache Ignite 2.1.0 RC2

2017-07-18 Thread Valentin Kulichenko
+1 (binding) On Tue, Jul 18, 2017 at 11:40 AM, Denis Magda wrote: > +1 (binding) > > — > Denis > > > On Jul 17, 2017, at 9:42 PM, Vladimir Ozerov > wrote: > > > > Igniters! > > > > We have uploaded a 2.1.0 release candidate to > >

Re: [VOTE] Apache Ignite 2.1.0 RC3

2017-07-20 Thread Valentin Kulichenko
+1 (binding) On Thu, Jul 20, 2017 at 9:35 PM, Sasha Belyak wrote: > +1 > > 2017-07-21 5:34 GMT+07:00 Denis Magda : > > > Igniters, > > > > Setting off the vote one more time. Hope I’ll be successful this time, > > keeping fingers crossed :) > > > > We have

Re: Timeouts in atomic cache

2017-07-21 Thread Valentin Kulichenko
Any thoughts? -Val On Wed, Jul 19, 2017 at 4:21 PM, Valentin Kulichenko < valentin.kuliche...@gmail.com> wrote: > Folks, > > Do we currently have any way to set a timeout for an atomic operation? I > don't see neither a way to do this nor any related documentatio

Re: Ignite internal events tracing

2017-07-21 Thread Valentin Kulichenko
Alex, That's a great idea. I would also add an option to dump information on demand, for case when operation hanged and can't complete. -Val On Fri, Jul 21, 2017 at 6:15 AM, Alexey Goncharuk < alexey.goncha...@gmail.com> wrote: > Igniters, > > I've recently stumbled across a situation when

Re: Changing public IgniteCompute API to improve changes in 5037 ticket

2017-07-21 Thread Valentin Kulichenko
T arg) > throws IgniteException; > public <T, R> ComputeTaskFuture affinityExecuteAsync(AffinityComputeTask<T, > R> task, List partIds, @Nullable T arg) throws IgniteException; > > > How do you like this idea or do you insist that you need to use > @Aff

Re: Resurrect FairAffinityFunction

2017-07-25 Thread Valentin Kulichenko
an compare rendezvous and fair affinity functions? > > Thanks > > On Tue, Jul 25, 2017 at 5:13 AM, <dsetrak...@apache.org> wrote: > > > Agree with Val, we should bring it back. > > > > ⁣D.​ > > > > On Jul 24, 2017, 8:14 PM, at 8:14 PM, V

Re: Changing public IgniteCompute API to improve changes in 5037 ticket

2017-07-25 Thread Valentin Kulichenko
. How can I assign task for each cache partition ? > > > > > > 3. How can I enforce partition reservation if task works with multiple > > > caches at once ? > > > > > > > > > > > > > > > > > > 2017-07-25 12:30 G

Re: Changing public IgniteCompute API to improve changes in 5037 ticket

2017-07-25 Thread Valentin Kulichenko
:37 PM, Valentin Kulichenko < valentin.kuliche...@gmail.com> wrote: > Anton, > > How does topology change break this functionality? Closures executed with > affinityRun/Call fail over in the same way as any ComputeJob. > > -Val > > On Tue, Jul 25, 2017 at 5:48 AM,

Re: Resurrect FairAffinityFunction

2017-07-25 Thread Valentin Kulichenko
Create a ticket: https://issues.apache.org/jira/browse/IGNITE-5836 -Val On Tue, Jul 25, 2017 at 11:54 AM, Valentin Kulichenko < valentin.kuliche...@gmail.com> wrote: > Semyon, > > We had some improvements, but to knowledge fair affinity still provides > much better distri

Re: Changing public IgniteCompute API to improve changes in 5037 ticket

2017-07-24 Thread Valentin Kulichenko
t work for map/reduce. > > On Fri, Jul 21, 2017 at 11:42 PM, Valentin Kulichenko < > valentin.kuliche...@gmail.com> wrote: > > > Maxim, > > > > The issue is that it's currently assumed to support job mapping, but it > > actually doesn't. However, I agree that

Re: [VOTE] Apache Ignite 2.1.0 RC4

2017-07-24 Thread Valentin Kulichenko
+1 (binding) On Mon, Jul 24, 2017 at 6:39 AM, Dmitriy Setrakyan wrote: > Anton, > > You should treat this vote as a brand new vote. According to Apache rules, > you need 3 +1 votes and it has to go for 72 hours. > > D. > > On Mon, Jul 24, 2017 at 8:32 AM, Anton Vinogradov

Resurrect FairAffinityFunction

2017-07-24 Thread Valentin Kulichenko
Guys, Some time ago we removed FairAffinityFunction from the project. However, my communication with users clearly shows that is was a rush decision. Distribution showed by Fair AF is much better than default and for some users it's extremely important. Basically, there are cases when rendezvous

Re: Ignite internal events tracing

2017-07-24 Thread Valentin Kulichenko
Yakov, How IgniteDiagnosticAware can be used? Is there any information? -Val On Mon, Jul 24, 2017 at 3:24 AM, Yakov Zhdanov wrote: > Alex, I like the idea very much, but I think we need to rethink the > implementation approach to make it more generic. Passing parameter to

Re: Timeouts in atomic cache

2017-07-24 Thread Valentin Kulichenko
Yakov, Thanks for response. I definitely like the idea of detecting Java level deadlocks. As for hangs caused by Ignite internal problems, do we have a ticket for this as well? Do you have any idea about how this should be implemented? -Val On Mon, Jul 24, 2017 at 3:55 AM, Yakov Zhdanov

Re: Non-UTF-8 string encoding support in BinaryMarshaller (IGNITE-5655)

2017-07-27 Thread Valentin Kulichenko
Pavel, This forces user to implement Binarylizable for whole type in case they want to change encoding for one-two fields, right? I really don't like it, why not add default encoding to BinaryTypeConfiguration? -Val On Thu, Jul 27, 2017 at 7:54 AM, Pavel Tupitsyn wrote:

Re: Assertions as binary data validation checks in deserialization

2017-07-27 Thread Valentin Kulichenko
Andrey, How will it corrupt the data? Assertions only reads the array, not updates it, right? -Val On Thu, Jul 27, 2017 at 8:54 AM, Andrey Kuznetsov wrote: > Hi Igniters, > > While examining BinaryObjectImpl code I found this curious line in typeId() > method: > > assert

Re: Assertions as binary data validation checks in deserialization

2017-07-27 Thread Valentin Kulichenko
o-op in production, and we silently > ignore binary format violation. > > 27 июля 2017 г. 21:09 пользователь "Valentin Kulichenko" < > valentin.kuliche...@gmail.com> написал: > > > Andrey, > > > > How will it corrupt the data? Assertions only reads the arra

Re: Assertions as binary data validation checks in deserialization

2017-07-27 Thread Valentin Kulichenko
wrote: > Indeed, "let it crash" approach is better than unclear error in some > indeterminate place later. Here we depend on data from "inpredictable" > source, so assertions are not suitable. > > 27 июля 2017 г. 22:35 пользователь "Valentin Kulichenko" <

Re: ContinuousQueryWithTransformer implementation questions

2017-07-26 Thread Valentin Kulichenko
Nikolay, We already have the following method for queries with transformer. It currently throws exception for ContinuousQuery. QueryCursor query(Query qry, IgniteClosure transformer) Would it be possible to utilize it instead of creating new API? -Val On Wed, Jul 26, 2017 at 5:26

Re: Changing public IgniteCompute API to improve changes in 5037 ticket

2017-07-26 Thread Valentin Kulichenko
unstable topology in case partition was not losed, only relocated to > another node during rebalancing. > > On Tue, Jul 25, 2017 at 10:44 PM, Valentin Kulichenko < > valentin.kuliche...@gmail.com> wrote: > > > Alexey, > > > > Is there exact use case that is cu

Re: ContinuousQueryWithTransformer implementation questions

2017-07-26 Thread Valentin Kulichenko
only transformer. > > Moreover I think I should somehow "extend" ContinuousQuery(my proposal is > new class with similar name) because issue is about possibility of > optimization of continuous query mechanism. > > Thoughts? > > > 26.07.2017 20:56, Valentin

Timeouts in atomic cache

2017-07-19 Thread Valentin Kulichenko
Folks, Do we currently have any way to set a timeout for an atomic operation? I don't see neither a way to do this nor any related documentation. In the code there are CacheAtomicUpdateTimeoutException and CacheAtomicUpdateTimeoutCheckedException, but I can't find a single place where it's

Re: Zookeeper Discovery SPI & external IP address in AWS

2017-06-28 Thread Valentin Kulichenko
Yakov, Private address should be published as well, of course. -Val On Wed, Jun 28, 2017 at 3:47 AM, Yakov Zhdanov wrote: > Val, > > What if client sits in a private network, too? > > Btw, do we pass all addresses through address resolver prior to sealing > node

Re: By bytes access to binary format

2017-06-28 Thread Valentin Kulichenko
Vladislav, Are you suggesting to stream directly from cache. or from a binary object that is already copied from cache? -Val On Wed, Jun 28, 2017 at 2:52 AM, Vladislav Pyatkov wrote: > Hi, > > Recently, from one of Ignite user, I listened interest idea. > What if I want

Re: It seems WebSession's removeAttribute does not support HttpSessionBindingListener

2017-06-28 Thread Valentin Kulichenko
Hi, Good catch! I created a ticket for this: https://issues.apache.org/jira/browse/IGNITE-5607 Are you willing to pick it up and contribute the fix? -Val On Wed, Jun 28, 2017 at 3:25 AM, yucigou wrote: > When a session expires or is invalidated, or a session attribute

Re: By bytes access to binary format

2017-06-30 Thread Valentin Kulichenko
). > > > > For the stream in/out to cache I will be used IGFS. > > Main idea to avoid GC pressure when make a massive read from key-value > > storage. > > > > On Wed, Jun 28, 2017 at 9:36 PM, Valentin Kulichenko < > > valentin.kuliche...@gmail.com> wrote: &

Re: [jira] [Created] (IGNITE-5647) Suggestion for Apache Ignite Generic Transactional Receiver Implementation for Concurrency

2017-06-30 Thread Valentin Kulichenko
Hi Fatih, You can find this information here: https://ignite.apache.org/community/contribute.html#ignite-dev -Val On Fri, Jun 30, 2017 at 11:43 AM, fatih wrote: > Hi > > Could please send a guide for a new committer explaining how to create a > branch to the dedicated

Re: Distributed scheduling

2017-06-30 Thread Valentin Kulichenko
I think this functionality should provide durable way of scheduled task or closure execution on the cluster. Job descriptors should be persisted on server side and executed there. As for API, I believe this should be part of Compute Grid. I suggest to introduce

Re: DataStreamer Transactional and Timestamp Implementation

2017-06-30 Thread Valentin Kulichenko
Hi Fatih, This makes sense to me, but frankly I don't see anything that can be included in the product here. It's very specific to your case and doesn't add much value in general. Do you have a blog by any chance? :) It looks like a very good topic for an article (describing the use case,

Re: Custom string encoding

2017-06-30 Thread Valentin Kulichenko
t; data. > > But.. would it be compatible with H2 indexing ? I doubt. > > 1 июля 2017 г. 2:27 пользователь "Valentin Kulichenko" < > valentin.kuliche...@gmail.com> написал: > > > Folks, > > > > Currently binary marshaller always encodes strings in U

Custom string encoding

2017-06-30 Thread Valentin Kulichenko
Folks, Currently binary marshaller always encodes strings in UTF-8. However, sometimes it can be useful to customize this. For example, if data contains a lot of Cyrillic, Chinese or other symbols, but not so many Latin symbols, memory is used very inefficiently. In this case it would be great to

Re: Distributed scheduling

2017-07-03 Thread Valentin Kulichenko
named scheduler and ensure that > we don't schedule the same task more than once. This is beginning to look > more like a durable cluster singleton service, no? > > D. > > On Fri, Jun 30, 2017 at 1:39 PM, Valentin Kulichenko < > valentin.kuliche...@gmail.com> wrote: >

Re: Zookeeper Discovery SPI & external IP address in AWS

2017-07-03 Thread Valentin Kulichenko
To my knowledge it's the case, there should be any issues with that. -Val On Mon, Jul 3, 2017 at 3:55 AM, Yakov Zhdanov wrote: > My point is that communication SPI should put both address types to its > attributes to share - private and addresses processed by a resolver. >

Re: Custom string encoding

2017-07-03 Thread Valentin Kulichenko
; On Sun, Jul 2, 2017 at 12:26 PM, Valentin Kulichenko < > valentin.kuliche...@gmail.com> wrote: > > > Vova, > > > > That's actually a good point. Probably that would be enough and there is > no > > need to introduce absract encoder. However, I still think

Re: Custom string encoding

2017-07-02 Thread Valentin Kulichenko
> > > > > > wrote: > > > > > > > > > > > > > In SQL indexes we may store partial strings and assume them to > be > > > in > > > > > > UTF-8, > > > > > > > I don't think this can be abst

Re: Server stores cache data on-heap if client has near cache - IGNITE-4662

2017-06-27 Thread Valentin Kulichenko
I'm not sure this ticket is valid for 2.0. Semen, can you comment? -Val On Tue, Jun 27, 2017 at 1:14 AM, Vyacheslav Daradur wrote: > Hi Igniters. > > I have some questions according to this task: > > 1. Does the method: GridCacheMapEntry#evictInternal do the >

Re: It seems WebSession's removeAttribute does not support HttpSessionBindingListener

2017-07-05 Thread Valentin Kulichenko
Hi, This fix seems to address only particular case when attribute is expired. But this will not work in generic case, right? For example, if attribute is put and removed explicitly, listener will not be invoked. I don't think we should rely on underlying session here, the logic has to be properly

Re: BinaryObjectImpl.deserializeValue with specific ClassLoader

2017-04-25 Thread Valentin Kulichenko
We allow to provide custom class loader via IgniteConfiguration.setClassLoader. If this class loader is ignored during deserialization of cache objects, then I believe it's a bug. -Val On Tue, Apr 25, 2017 at 7:36 PM, Denis Magda wrote: > Nick, > > This deserialization issue

Re: Handling of @AffinityKeyMapped and @QuerySqlField annotations in Cassandra store

2017-04-25 Thread Valentin Kulichenko
I agree. Using @QuerySqlField in Cassandra store seems to be incorrect design decision in the first place. -Val On Tue, Apr 25, 2017 at 2:22 PM, Vladimir Ozerov wrote: > Hi Igor, > > During API stabilization and improvement for Apache Ignite 2.0 we > restricted usage of

Webinar: Building Consistent and Highly Available Distributed Systems with Apache Ignite

2017-07-31 Thread Valentin Kulichenko
Igniters, This Wednesday (August 2nd at 11am PT), I will host a webinar where I will go through different Apache Ignite features and capabilities that allow to build consistent and highly available distributed systems. More information here:

Re: Resurrect FairAffinityFunction

2017-08-09 Thread Valentin Kulichenko
As far as I know, all logical caches with the same affinity function and node filter will end up in the same group. If that's the case, I like the idea. This is exactly what I was looking for. -Val On Wed, Aug 9, 2017 at 8:18 AM, Evgenii Zhuravlev wrote: > Dmitriy, >

igniterouter.sh

2017-08-07 Thread Valentin Kulichenko
Folks, Our bin folder still contains igniterouter.{sh|bat} script. Previously it was used to support indirect access from thin client to cluster. Since thin client is deprecated for a while, is there a use case when router can be used? I think it makes sense to remove these scripts for now. If

Re: igniterouter.sh

2017-08-07 Thread Valentin Kulichenko
, Vladimir Ozerov <voze...@gridgain.com> wrote: > Val, > > Thin client is like Arnold - he'll be back ) We already working on it. I > propose to delay this question a bit, until we understand that router is > not needed for new thin client. > > пн, 7 авг. 2017 г. в

Re: ERROR: Heuristic transaction failure.

2017-08-17 Thread Valentin Kulichenko
Hi Usein, Which Java version do you have? There was a similar thread already where this exception was fixed by upgrading to the latest one:

Re: Failure to deserialize simple model object

2017-08-17 Thread Valentin Kulichenko
Guys, Does anyone has ideas? -Val On Mon, Aug 14, 2017 at 4:33 PM, Valentin Kulichenko < valentin.kuliche...@gmail.com> wrote: > Cross-posting to dev > > Folks, > > I'm confused by the issue discussed in this thread. > > Here is the scenario: > - Start server nod

Re: Policy for update third-party dependencies

2017-08-20 Thread Valentin Kulichenko
Guys, Keep in mind that some projects can use *older* version of third-party libraries as well, and dependency upgrade can break them. In other words, dependency upgrade is in many cases an incompatible change for us, so we should do this with care. Unless there is a specific reason to upgrade a

Re: Store data from Python in multiple caches using Redis or Memcached client in Apache ignite

2017-05-16 Thread Valentin Kulichenko
To my knowledge, Memcached does not allow to do this. -Val On Mon, May 15, 2017 at 9:27 PM, Roman Shtykh wrote: > Denis, yes, I would like to enable switching caches via "CONFIG SET > parameter value".I created https://issues.apache.org/ > jira/browse/IGNITE-5229 for

Re: [DISCUSS] Webinar for Ignite Persistent Store walk-through

2017-06-09 Thread Valentin Kulichenko
+1 On Fri, Jun 9, 2017 at 3:15 PM, Andrey Mashenkov wrote: > +1 > > 10 июня 2017 г. 0:08 пользователь "William Do" > написал: > > > +1 > > > > On 9 June 2017 at 21:37, Dmitriy Setrakyan > wrote: > > > > > Hm... we have

Re: Zookeeper Discovery SPI & external IP address in AWS

2017-06-21 Thread Valentin Kulichenko
Igor, What version are you going on? I believe we already fixed this in the past. -Val On Wed, Jun 21, 2017 at 2:30 AM Igor Rudyak wrote: > Hi guys, > > How to force *TcpDiscoveryZookeeperIpFinder* to publish public IP address > (in addition to private IP) of Ignite node

Re: Replace Cron4J with Quartz for ignite-schedule module.

2017-06-21 Thread Valentin Kulichenko
I think Michael brought up a very good point. Current ignite-scheduler module schedules jobs only locally which is not very useful in distributed system. I don't think I've ever seen it used and I don't think it makes sense to spend time on it if we just replace one dependency with another.

Re: IGNITE-2894 - Binary object inside of Externalizable still serialized with OptimizedMarshaller

2017-06-21 Thread Valentin Kulichenko
ls.java:1833 in PR). We will use this fix or return > BinaryObjectExImpl? > > 3. What are priority if was implemented several interfaces: Binarylizable > -> Externalizable -> Serializable ? > > Also can you pre review this issue? > PR: https://github.com/apache/ignite/pul

Re: Zookeeper Discovery SPI & external IP address in AWS

2017-06-21 Thread Valentin Kulichenko
Igor, Here is the ticket I'm talking about: https://issues.apache.org/jira/browse/IGNITE-3230 -Val On Wed, Jun 21, 2017 at 8:57 AM, Igor Rudyak <irud...@gmail.com> wrote: > Val, > > Are there any ticket for this in Jira? > > Igor > > On Jun 21, 2017 5:

Re: IgniteCache#localEvict method

2017-06-21 Thread Valentin Kulichenko
s, > > Ivan Rakov > > > > On 19.06.2017 17:01, Igor Sapego wrote: > > > >> What if user enables on-heap cache? > >> > >> Best Regards, > >> Igor > >> > >> On Mon, Jun 19, 2017 at 3:34 AM, Dmitriy Setrakyan < > dsetrak..

Re: Zookeeper Discovery SPI & external IP address in AWS

2017-06-21 Thread Valentin Kulichenko
Igor Rudyak <irud...@gmail.com> wrote: > > > > > Val, > > > > > > Are there any ticket for this in Jira? > > > > > > Igor > > > > > > On Jun 21, 2017 5:50 AM, "Valentin Kulichenko" < > > > valentin.kulich

Re: IgniteCache#localEvict method

2017-06-26 Thread Valentin Kulichenko
Created ticket: https://issues.apache.org/jira/browse/IGNITE-5592 -Val On Sun, Jun 25, 2017 at 7:49 AM, Ivan Rakov <ivan.glu...@gmail.com> wrote: > Agree as well. > > Best Regards, > Ivan Rakov > > On 22.06.2017 1:23, Valentin Kulichenko wrote: > > I agree

Re: Zookeeper Discovery SPI & external IP address in AWS

2017-06-26 Thread Valentin Kulichenko
Yakov, Nodes that join outside of the network (usually these are clients) need to know public addresses to connect. To make it work either of these must happen: 1. Server nodes publish their public addresses in IP finder so that clients can use them to connect. 2. Client nodes use address

Re: Zookeeper Discovery SPI & external IP address in AWS

2017-06-26 Thread Valentin Kulichenko
On Mon, Jun 26, 2017 at 3:32 PM, Valentin Kulichenko < > valentin.kuliche...@gmail.com> wrote: > > > Igor, > > > > Are you sure these connections are not blocked by firewall? If you > provide > > addresses explicitly in static IP finder, then it doesn't matter

Re: Zookeeper Discovery SPI & external IP address in AWS

2017-06-26 Thread Valentin Kulichenko
> * * > ** > > It still can't connect to cluster and just periodically reports the same > error. > > Does actually cluster membership protocol support the case when node > available through multiple IP addresses and treats , > and etc. as just different IPs correspon

Re: Zookeeper Discovery SPI & external IP address in AWS

2017-06-26 Thread Valentin Kulichenko
wrote: > Option 2 also will not work for IaaS environments, where node can > dynamically join or leave cluster. > > Igor > > On Jun 26, 2017 12:12 PM, "Valentin Kulichenko" < > valentin.kuliche...@gmail.com> wrote: > > > Yakov, > > > > Nodes t

Re: Session Replication Update on spring boot platform

2017-05-22 Thread Valentin Kulichenko
Hi Rishi, I'm not sure I understand what the issue is. Can you elaborate a bit more and provide exact examples of what is not working? What code tweaks are required and how critical are they? Also I recall that your example was working fine after the latest fixes in 1.9 (if I'm not mistaken). Did

Re: Inefficient approach to executing remote SQL queries

2017-05-22 Thread Valentin Kulichenko
Hi Mike, Generally, establishing connections in parallel could make sense, but note that in most this would be a minor optimization, because: - Under load connections are established once and then reused. If you observe disconnections during application lifetime under load, then

Re: [VOTE] Accept Contribution of Ignite Persistent Store

2017-05-23 Thread Valentin Kulichenko
+1 On Tue, May 23, 2017 at 8:42 AM, Semyon Boikov wrote: > +1 > > On Tue, May 23, 2017 at 12:55 AM, Denis Magda wrote: > > > Igniters, > > > > This branch (https://github.com/apache/ignite/tree/ignite-5267) adds a > > distributed and transactional

Cassandra store and binary objects

2017-05-22 Thread Valentin Kulichenko
Hi Igor, Can you please clarify if Cassandra store can work directly with binary objects or not, when POJO strategy is used? In other words, are POJO classes required on server nodes for this strategy? What will happen if CacheConfiguration#keepBinaryInStore property set to true? -Val

Re: Session Replication Update on spring boot platform

2017-05-23 Thread Valentin Kulichenko
solution could be spring session. > > The example which I posted can be tested on cluster as well. Would Ignite > team try out the clustering ? > > Looking for your inputs / suggestions on the issue. > > Thank you for all your help, > Rishi > > > > > On Mon

IgniteCompute async methods do not return ComputeTaskFuture

2017-05-30 Thread Valentin Kulichenko
Folks, I noticed that the new async API for IgniteCompute returns IgniteFuture, while previously we used to have its extension - ComputeTaskFuture, which contains useful information about the executed task session. Should this be fixed? -Val

Re: Cassandra and Ignite C++ Issue

2017-05-30 Thread Valentin Kulichenko
Igor, There is another SO question about this, I already responded: https://stackoverflow.com/questions/44254079/ignite-with-cassandra-integration -Val On Tue, May 30, 2017 at 10:15 AM, Igor Sapego wrote: > User's answer: > I have changed my POJO to BLOB. > > Current

Re: IgniteCompute async methods do not return ComputeTaskFuture

2017-05-30 Thread Valentin Kulichenko
teFuture for closure methods, as there is no notion of > "session" > > and "task" for them. ComputeTaskFuture now returned only from > task-related > > methods ("execute"). Unless I am missing something, this approach looks > > correct. > > > > > &g

Re: Data compression in Ignite 2.0

2017-06-07 Thread Valentin Kulichenko
Vyacheslav, Anton, Are there any ideas and/or prototypes for the API? Your design suggestions seem to make sense, but I would like to see how it all this will like from user's standpoint. -Val On Wed, Jun 7, 2017 at 1:06 AM, Антон Чураев wrote: > Vyacheslav, correct me

Re: BinaryObjectImpl.deserializeValue with specific ClassLoader

2017-06-07 Thread Valentin Kulichenko
Hi Nick, How exactly do you replace the class loader and can you give a little bit more detail about why you do this? As for the issues, here are my comments: 1. Can you clarify this? In which scenario it doesn't work and why? 2. Why do you deploy domain classes in the first place? Ignite

Cassandra related question

2017-06-08 Thread Valentin Kulichenko
Igor, Can you please take a look at this question from a user? Is it a bug? http://apache-ignite-users.70518.x6.nabble.com/Ignite-Cassandra-Exception-td13529.html -Val

Re: Key type name and value type name for CREATE TABLE

2017-06-06 Thread Valentin Kulichenko
Vova, If you add unique suffix losing human-readable type names, how will the builder approach work? Maybe it makes sense to add an API call that returns current type name for a table? -Val On Tue, Jun 6, 2017 at 7:43 PM Dmitriy Setrakyan wrote: > Vova, > > I am not

IgniteCache#localEvict method

2017-06-18 Thread Valentin Kulichenko
Folks, Does the subj make sense in 2.0? Before this method could be used to evict from on-heap memory to off-heap or swap. What are the semantics now? -Val

Re: [VOTE] Apache Ignite 2.0.0 RC2

2017-05-01 Thread Valentin Kulichenko
+1 On Mon, May 1, 2017 at 3:12 PM Vladimir Ozerov wrote: > +1 > > 30 апр. 2017 г. 17:46 пользователь "Denis Magda" > написал: > > > Igniters! > > > > We have uploaded a 2.0.0 release candidate to > >

Re: ContiniousQuery giving notification for different dataset

2017-05-08 Thread Valentin Kulichenko
Continuous queries are predicate-based. Initial query is a separate optional feature that allows you to fetch the data that existed before listener was registered, it does not affect further update notifications in any way. Having said that, the behavior you observe is correct. -Val On Mon, May

Re: Zookeeper Discovery SPI & external IP address in AWS

2017-06-27 Thread Valentin Kulichenko
Yakov, What do you mean by 'mixture'? :) Client obviously needs to know public addresses to connect and I think it's natural to get them from IP finder. Is there something wrong with this? -Val On Tue, Jun 27, 2017 at 5:01 AM, Yakov Zhdanov wrote: > >>Both will work, but

Re: DataStreamer Transactional and Timestamp Implementation

2017-06-27 Thread Valentin Kulichenko
Fatih, Can you give more details about the use case addressed by this implementation? -Val On Tue, Jun 27, 2017 at 3:45 PM, Denis Magda wrote: > Faith, > > Thanks for sharing it with us. > > In general, we can always wrap this code up in a form of an example to be >

AffinityKeyMapper alternatives

2017-09-11 Thread Valentin Kulichenko
Guys, Some time ago we deprecated AffinityKeyMapper in favor of CacheKeyConfiguration#affinityKeyFieldName and AffinityKeyMapped annotation. While I understand the reasons why we did this, I think it's not very flexible as requires to specify the field name on node startup. First of all,

Re: Unintuitive error message when invalid marshaller files found

2017-09-15 Thread Valentin Kulichenko
Mike, Can you show the exception that is thrown? -Val On Fri, Sep 15, 2017 at 7:12 AM, Michael Griggs wrote: > This afternoon I came across an unusual case where there were files in > my work/marshaller folder with invalid filenames. It seems that the > valid format is

Re: Unintuitive error message when invalid marshaller files found

2017-09-18 Thread Valentin Kulichenko
I agree, error message should be more informative. Mike, feel free to create a Jira ticket for this. -Val On Mon, Sep 18, 2017 at 12:25 AM, Michael Griggs wrote: > Sure > > SEVERE: Exception during start processors, node will be stopped and > close connections > class

Issues if -Djava.net.preferIPv4Stack=true is not set

2017-09-18 Thread Valentin Kulichenko
Guys, I noticed there are many issues on user forum that occur of -Djava.net.preferIPv4Stack=true system property is not set. Can someone explain the nature of these issues? What exactly in Ignite requires this system property do be set? And can this be fixed/automated somehow? If fix is not

Re: Expiry policy for Cache.invoke

2017-09-13 Thread Valentin Kulichenko
Denis, I'm confused by the issue. Do you mean that we can use expiry policy other than the one provided in configuration? How is this possible? Can you point to the code that implements this logic? -Val On Wed, Sep 13, 2017 at 11:29 AM, Dmitriy Setrakyan wrote: > Denis,

Re: Web Sessions not considered valid by our RequestWrapper - FIX

2017-09-13 Thread Valentin Kulichenko
ion. > But I still think it tests too little for too much effort. What do you > think? > > Regards, > > -- > Ilya Kasnacheev > > 2017-09-13 2:33 GMT+03:00 Valentin Kulichenko < > valentin.kuliche...@gmail.com > >: > > > Ilya, > > > > I

Re: Expiry policy for Cache.invoke

2017-09-14 Thread Valentin Kulichenko
nite.apache.org/releases/latest/javadoc/org/ > apache/ignite/IgniteCache.html#invoke(K,%20org.apache.ignite.cache. > CacheEntryProcessor,%20java.lang.Object...)> is > > used, somehow depend on the configured atomicity. Of course, the > configured > > ExpiryPolicy is used, but

Re: IGNITE-2894 - Binary object inside of Externalizable still serialized with OptimizedMarshaller

2017-09-22 Thread Valentin Kulichenko
gt; What are your thoughts? > > > 2017-09-19 20:10 GMT+03:00 Valentin Kulichenko < > valentin.kuliche...@gmail.com>: > > > Nikita, > > > > It sounds like the test should be changed, no? In case I'm missing > > something, can you please give more details

Re: IGNITE-2894 - Binary object inside of Externalizable still serialized with OptimizedMarshaller

2017-09-19 Thread Valentin Kulichenko
n BinaryUtils.mode(cls) to > >> define > >> > > BinaryWriteMode in a proper way. > >> > > Could you please review and comment my solution [2]? > >> > > > >> > > BTW, I have benchmarked my solution by GridMarshallerPerformanceTest > >

Re: Binary compatibility of persistent storage

2017-09-19 Thread Valentin Kulichenko
In my view, there are two different scenarios. First - user just upgrades the version (to get some bug fix, for example), but does not intend to change anything in their project and/or use any new features. In this case it should work transparently and cluster must be able to work with older

<    1   2   3   4   5   6   7   8   9   10   >