Re: NodeFilter for cache and GridDhtPartitionsExchangeFuture (Failed to wait for partition release future)

2017-07-07 Thread Vladimir
>>> What is the exact scenario when cache is not available? If this means absence of node A, then you can lose after initialization of B, It is just a test. In real project, of course, there are many nodes holding the cache. Node A represents a part of cluster. >>> I would recommend to use

Re: NodeFilter for cache and GridDhtPartitionsExchangeFuture (Failed to wait for partition release future)

2017-07-03 Thread Vladimir
Here it is: logs_dumps.zip -- View this message in context:

Re: NodeFilter for cache and GridDhtPartitionsExchangeFuture (Failed to wait for partition release future)

2017-07-03 Thread Vladimir
YourKits thinks: Frozen threads found (potential deadlock) It seems that the following threads have not changed their stack for more than 10 seconds. These threads are possibly (but not necessarily!) in a deadlock or hung. exchange-worker-#29%null% <--- Frozen for at least 14s

BinaryInvalidTypeException: Unknown pair [platformId=.., typeId=...] when using CacheJdbcPojoStoreFactory and read/write-through

2017-06-05 Thread Vladimir
Greetings! Can anyone please help me with cache store feature? Once I add to my cache config CacheJdbcPojoStoreFactory and enable read/write-through I can't get any value from the cache because of the deserialization exception: org.apache.ignite.binary.BinaryInvalidTypeException: Unknown pair

Re: Failed to wait for initial partition map exchange

2017-06-07 Thread Vladimir
Unfortunately, it’s not a warning. New node cannot join the cluster. And there is no heavy load on the cluster, no CPU/memory consumption. No any network problem because I tested all the nodes on single machine. -- View this message in context:

Re: BinaryInvalidTypeException: Unknown pair [platformId=.., typeId=...] when using CacheJdbcPojoStoreFactory and read/write-through

2017-06-06 Thread Vladimir
>>> Try to add key\value classes in BinaryConfiguration. Btw any example? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/BinaryInvalidTypeException-Unknown-pair-platformId-typeId-when-using-CacheJdbcPojoStoreFactory-and-rh-tp13384p13402.html Sent from the

Node can't start. java.lang.NullPointerException in GridUnsafe.compareAndSwapLong()

2017-06-09 Thread Vladimir
Hi, Having no problems on Windows and Linux application suddenly couldn't start on IBM AIX with IBM J9 VM (build 2.8): Caused by: java.lang.NullPointerException at org.apache.ignite.internal.util.GridUnsafe.compareAndSwapLong(GridUnsafe.java:1228) ~[ignite-core-2.0.0.jar!/:2.0.0]

Re: Failed to wait for initial partition map exchange

2017-06-13 Thread Vladimir
INFO 2017-06-13 20:36:22 [localhost-startStop-1] org.apache.ignite.internal.IgniteKernal%svip - [[OS: Linux 4.1.12-61.1.18.el7uek.x86_64 amd64]] INFO 2017-06-13 20:36:22 [localhost-startStop-1] org.apache.ignite.internal.IgniteKernal%svip - [[PID: 7608]] [20:36:22] VM information: Java(TM) SE

Re: Failed to wait for initial partition map exchange

2017-06-06 Thread Vladimir
I have met similar problem too. A node cannot start: WARN 16:08:36.158 [main] org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager: Still waiting for initial partition map exchange [fut=GridDhtPartitionsExchangeFuture [dummy=false, forcePreload=false, reassign=false,

Re: BinaryInvalidTypeException: Unknown pair [platformId=.., typeId=...] when using CacheJdbcPojoStoreFactory and read/write-through

2017-06-05 Thread Vladimir
Thanks. Looks like so. There is no class data in the file store. A workaround might putting a value to the cache. That makes it working. But I don't want to put any junk to my DB :) -- View this message in context:

Re: BinaryInvalidTypeException: Unknown pair [platformId=.., typeId=...] when using CacheJdbcPojoStoreFactory and read/write-through

2017-06-06 Thread Vladimir
Thanks. A simple BinaryConfiguration has helped in the case of one isolated node or more nodes with the same configuration. The problem is that the storable cache is configured with the node filter. So, only several nodes share the cache. Another nodes aren't supposed to know anything about these

Re: Trouble with v 2.3.0 on AIX

2017-11-13 Thread Vladimir
Logs uploaded. Node1 started first. Node2 couldn't join the cluster. Search for first "java.lang.IllegalArgumentException: null" in node2.log node1.zip node2.zip

Trouble with v 2.3.0 on AIX

2017-11-02 Thread Vladimir
Hi, Just upgraded from Ignite 2.1.0 to v.2.3.0. And now our several nodes cannot start on AIX 7. The error: ERROR 2017-11-02 11:59:01.331 [grid-nio-worker-tcp-comm-1-#22] org.apache.ignite.internal.util.nio.GridDirectParser: Failed to read message [msg=GridIoMessage [plc=0, topic=null,

Re: Trouble with v 2.3.0 on AIX

2017-11-02 Thread Vladimir
No single and simple configuration is available. But notging special: default or slightly changed memory policy, replicated and partitioned caches (mostly atomic), write-through persistence, tcp-discovery, continous queries, services -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: IGFS backed by persistence on physical filesystem

2015-11-16 Thread Vladimir Ozerov
Yes, I thought the same. Looks like I didn't understand how FUSE works when answering. On Mon, Nov 16, 2015 at 10:13 PM, vkulichenko <valentin.kuliche...@gmail.com > wrote: > Vladimir Ozerov wrote > > Some time ago there was a discussion to implement native IGFS -> OS

Re: 答复: How to access data stored in IGFS or IGFS as Hadoop cache

2015-09-07 Thread Vladimir Ozerov
the performance of these two file system, what > shall I do? > > > > 2. I tried to set fs.defaultFS as “igfs:///”, but hadoop could not > start for no namenode detected > > > > > > *发件人:* Vladimir Ozerov [mailto:voze...@gridgain.com] > *发送时间:* 2015年9月7日

Re: How to configure Hadoop accelerator for Hadoop-High Availability ?

2015-09-11 Thread Vladimir Ozerov
Jesu, Which Ignite version do you use? IgniteHadoopIgfsSecondaryFileSystem has 3 constructors: IgniteHadoopIgfsSecondaryFileSystem(String uri) IgniteHadoopIgfsSecondaryFileSystem(@Nullable String uri, @Nullable String cfgPath) IgniteHadoopIgfsSecondaryFileSystem(@Nullable String uri, @Nullable

Re: How to config Ignite on hadoop

2015-09-14 Thread Vladimir Ozerov
Hi xukun, Did you have a chance to check propsed solution with SHMEM endpoint? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-config-Ignite-on-hadoop-tp1306p1377.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: How to config Ignite on hadoop

2015-09-29 Thread Vladimir Ozerov
m/example-igfs.xml". Let me know if it helps. Vladimir. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-config-Ignite-on-hadoop-tp1306p1507.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: IGFS with local filesystem: Lifecycle of content

2015-12-08 Thread Vladimir Ozerov
Hi Kobe, Ansewring your questions: 2) Writes are batched based on "bufSize" parameter in methods IgniteFileSystem.create() and IgniteFileSystem.append(). 3) Do not understand the question. If you read files content through IGFS and file is in cache, IGFS will not touch underlying file system. If

Re: NPE issue with trying to submit Hadoop MapReduce

2015-12-08 Thread Vladimir Ozerov
d Ignite node ( http://search.maven.org/#search%7Cgav%7C1%7Cg%3A%22org.apache.ignite%22%20AND%20a%3A%22ignite-hadoop%22 ). Please let me know if this resolves your problem. Looking forward, we will improve exception message in such situations. Vladimir. On Sun, Dec 6, 2015 at 12:25 PM, mikep <michael.and

Re: NPE issue with trying to submit Hadoop MapReduce

2015-12-09 Thread Vladimir Ozerov
ensuring that meaningful error/warning is printed in such situations. Please let me know if it resolves your problem. Vladimir. On Wed, Dec 9, 2015 at 3:10 AM, mikep <michael.andre.pea...@me.com> wrote: > Hi Vladimir > > Heres a recreated example as standalone mini example with t

Re: Error running .net examples

2016-01-04 Thread Vladimir Ozerov
Hi Murthy, Could you please double-check that you have JAVA_HOME environment variable set and pointing to your Java installation directory? BTW, 1.5.0.final version was released recently [1]. There is no need to build Ignite.NET from sources anymore. Vladimir. [1] http://ignite.apache.org

Re: ignite in-memory sql query performance issue

2016-06-06 Thread Vladimir Ozerov
that. Vladimir. On Mon, Jun 6, 2016 at 5:56 AM, Zhengqingzheng <zhengqingzh...@huawei.com> wrote: > Hi there, > > When using sql query to get a list of objects, I find that the performance > is really slow. I am wondering, is this normal? > > I tried to call a sql query as fo

Re: ignite in-memory sql query performance issue

2016-06-07 Thread Vladimir Ozerov
are executed against the cache. Please let me know if you have any further questions. Vladimir. On Mon, Jun 6, 2016 at 12:19 PM, Zhengqingzheng <zhengqingzh...@huawei.com> wrote: > Hi Vladimir, > > I have tried to reset the group index definition. > > Using gId and oId as the group

Re: Where to watch the cache informations in IGFS when i use SecondryFileSystem

2016-06-15 Thread Vladimir Ozerov
Hi, Currently you can only access IGFS programatically, using *IgniteFileSystem.metrics() *method. If this is not an option for you, please attach the following: 1) Ignite configuration 2) Content of *core-site.xml* used for job execution. 3) Command line you use to start the job. Vladimir

Re: Can I get a better performance on BinaryMarshaller?

2016-06-24 Thread Vladimir Ozerov
Hi Lin, If you cannot change source code of classes, then you can use *BinarySerializer* interface. You can implement it and then assign with particular class using *BinaryTypeConfiguration*. Vladimir. On Fri, Jun 24, 2016 at 12:24 PM, Lin <m...@linlyu.com> wrote: > Hi Vladimir,

Re: TcpDiscoveryVmIpFinder's isShared property

2016-01-13 Thread Vladimir Ozerov
+1 to the question. Very confusing property. At the very least JavaDocs should be reworked significantly. On Wed, Jan 13, 2016 at 8:32 PM, Andrey Kornev wrote: > Hi there, > > I'm a bit confused about the purpose and usage of this property. What is > being shared with

Re: How to use rest api to put an object into cache?

2016-06-28 Thread Vladimir Ozerov
somehow and then convert it to real object inside interceptor. And the opposite: before returning object from cache you can convert it to some String form. This is not very convenient, though it will allow you to go further without awaiting any tickets to be implemented. Vladimir. On Mon, Jun 27

Re: Apache Drill querying IGFS-accelerated (H)DFS?

2016-02-07 Thread Vladimir Ozerov
Yep, will do. On Fri, Feb 5, 2016 at 11:17 PM, Dmitriy Setrakyan <dsetrak...@apache.org> wrote: > Great to hear. Would be nice to document this process. Vladimir, do you > mind taking a first crack at it and post it here for review? > > On Fri, Feb 5, 2016 at 12:

Re: IGFS dedicated writer node, multiple reader nodes

2016-02-08 Thread Vladimir Ozerov
eters (see org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsUtils class). Please let me know if you need any further assistance. Vladimir. On Mon, Feb 8, 2016 at 6:39 PM, pshomov <pe...@activitystream.com> wrote: > Hi Vladimir, > > Regarding option 1 > > >> 1) Have only one IGFS node in the cluster. That is,

Re: Apache Drill querying IGFS-accelerated (H)DFS?

2016-02-05 Thread Vladimir Ozerov
It looks like file system configuration is created inside WorkspaceSchemaFactory constructor: this.fsConf = plugin.getFsConf(); Does it mean that we have to implement our own Ignite's FileSystemPlugin to be able to work with Drill? On Fri, Feb 5, 2016 at 8:55 PM, Vladimir Ozerov <v

Re: Apache Drill querying IGFS-accelerated (H)DFS?

2016-02-05 Thread Vladimir Ozerov
exception is thrown (see stack trace below). I suspect that default Hadoop core-site.xml is not taken in consideration by Drill somehow. Could you please give us a hint on how to properly configure custom Hadoop FileSystem implementation in your system? Thank you!. Vladimir. Stack trace: java.io.I

Re: Apache Drill querying IGFS-accelerated (H)DFS?

2016-02-05 Thread Vladimir Ozerov
//igfs@/" to Apache Drill configuration and try quering data. Please let me know if you have any further problems during setup. Vladimir. On Fri, Feb 5, 2016 at 12:34 PM, pshomov <pe...@activitystream.com> wrote: > Hi Vladimir, > > Changed back fs.defaultFS (in my case to

Re: lock and unlock the cache key?

2016-02-11 Thread Vladimir Ozerov
Ravi, Please clarify what long do you mean? Here is short code snippet showing lock/unlock cycle: IgniteCache cache = ...; Lock lock = cache.lock(key); lock.unlock(); Vladimir. On Thu, Feb 11, 2016 at 1:12 PM, Ravi <ravikumarpur...@gmail.com> wrote: > Lock.unlock(long) here long

Re: Apache Drill querying IGFS-accelerated (H)DFS?

2016-02-05 Thread Vladimir Ozerov
ing for any Drill properties which point to Hadoop configuration file(s) and then check if these files really contain mentioned "fs.igfs.impl" property? Vladimir. On Fri, Feb 5, 2016 at 3:14 PM, pshomov <pe...@activitystream.com> wrote: > > ​Hi Vladimir, > > Tha

Re: Apache Drill querying IGFS-accelerated (H)DFS?

2016-02-05 Thread Vladimir Ozerov
Petar, Looks like this could be what we need - Storage Plugin - https://drill.apache.org/docs/plugin-configuration-basics/ Could you please try configuring new plugin for IGFS? If the problem is still there, could you please provide detailed error description and possibly logs? Vladimir

Re: IGFS: Data cache size

2016-02-07 Thread Vladimir Ozerov
, or leave default value. in the latter case Ignite will use between 50-80% of available heap as maximum IGFS size (see GridCacheAdapter constructor for exact size calculation logic). Please let me know if you have any further questions. Vladimir. On Mon, Feb 8, 2016 at 4:34 AM, Kobe <r...@mailcity.

Re: c++ native client

2016-02-28 Thread Vladimir Ozerov
ould store data and perform computations. Client node, to the contrast, do not do that and only instructs data nodes to do something. To start any node in client mode you should add the following line to XML configuration: Please let me know if you have any further questions. Vladimir. On Sun, Fe

Re: update the sql database after a particular limit?

2016-02-29 Thread Vladimir Ozerov
Ravi, What do you mean by "update the sql database"? If you configured a store and enabled write-through mode, database will be updated as soon as corresponding cached entry is changed. Vladimir. On Mon, Feb 29, 2016 at 2:54 PM, Ravi Puri <ravikumarpur...@gmail.com> wrote:

Re: NoSuchMethod Error

2016-02-29 Thread Vladimir Ozerov
-4.0/admin/advanced-classloaders.xtp Vladimir. On Sun, Feb 28, 2016 at 12:22 AM, jitesh dundas <jbdun...@gmail.com> wrote: > Hi, > > Some notes from the log:- > > ...skipping... > > Jiteshs-:~ jbdundas$ javap -public -cp > /Users/jbdundas/resin-4.0.36/deploy/_ear_j

Re: Semaphore waiting for permit even if node is shut down

2016-02-29 Thread Vladimir Ozerov
case (say, InterruptedException) as semaphore is no longer accessible when node is stopped. Vladislav, I know you worked on distributed semaphore. Could you please share your thoughts on the matter? And would you mind fixing that for a single-node scenario? Vladimir. On Sun, Feb 28, 2016 at 11:14 PM, nyname00

Re: IgniteCache: How to receive Load Re-balance notifications?

2016-02-29 Thread Vladimir Ozerov
Kamal, You should enable these event type in configuration. See IgniteConfiguration.setIncludeEventTypes(int ...) method. Vladimir. On Mon, Feb 29, 2016 at 12:00 PM, Kamal C <kamaltar...@gmail.com> wrote: > Hi, > > I have a replicated ignite cache with 3 nodes. I want to li

Re: Uberjar for IGFS 1.5.0

2016-02-15 Thread Vladimir Ozerov
-core/1.5.0.final [2] http://mvnrepository.com/artifact/org.apache.ignite/ignite-hadoop/1.5.0.final Vladimir. On Sat, Feb 13, 2016 at 4:07 AM, Kobe <r...@mailcity.com> wrote: > I am likely asking a question that pertains more to Maven than to IGFS. > I am trying to find if there i

Re: IGFS: Root of secondary backing store

2016-02-15 Thread Vladimir Ozerov
ou should pass "file:///" as URI and use full path then - "/data/analytics/hr". [1] https://hadoop.apache.org/docs/r2.6.1/api/org/apache/hadoop/fs/FileSystem.html#get(java.net.URI, org.apache.hadoop.conf.Configuration, java.lang.String) [2] https://en.wikipedia.org/wiki/Unifor

Re: binding exception?

2016-02-15 Thread Vladimir Ozerov
Ravi, Do you have the full stack trace of exception? On Mon, Feb 15, 2016 at 12:36 PM, Ravi wrote: > as I m running the tomcat server at certain port and then i try to start > the > configuration of xml on the same port it shows this exception why? > > how to judge

Re: Need your advice for using DataStreamer

2016-02-16 Thread Vladimir Ozerov
Ts. Have you tried single put per update from sender? If yes, then how far are results from desired performance numbers? If you give more detailed explanation of your use case and provide configuration you use, probably community will be able to give you some hints on how to improve performanc

Re: Externalizable in cache

2016-02-16 Thread Vladimir Ozerov
[]) and there is no more array data available. To the contrast, Java's ObjectInputStream returns -1 in this case. Looks like we should fix that. Thoughts? Vladimir. On Mon, Feb 15, 2016 at 10:32 PM, Myron Chelyada <myron.chely...@gmail.com> wrote: > Hello Alexey, > > This is actually not rea

Re: Huge heap size for ignite cache when storing 20 million objects of small size

2016-02-17 Thread Vladimir Ozerov
is. Vladimir. On Wed, Feb 17, 2016 at 8:18 AM, vidhu <mevidhusha...@gmail.com> wrote: > Thanks for quick reply. > > I mistakenly write 20 million to earlier but objects I am putting in cache > are 2 million which means .9 GB approx. > > Sorry for putting wrong number of objects earl

Re: changed cache configuration and restarted server nodes. Getting exception.

2016-02-18 Thread Vladimir Ozerov
Hi Vinay, It looks like there was a problem with serialization of one of Ignite internal components. Could you please provide the full stack trace of this exception? Any additional information like your source code or Ignite XML configuration could also help. Vladimir. On Thu, Feb 18, 2016 at 4

Re: Huge heap size for ignite cache when storing 20 million objects of small size

2016-02-18 Thread Vladimir Ozerov
serialization (i.e. with field names) and write the rest fields in binary mode. Also, as Val mentioned, indexes also consume some space. Vladimir. On Wed, Feb 17, 2016 at 9:36 PM, vidhu <mevidhusha...@gmail.com> wrote: > Hi Vladimir, > > We are using 2 server nodes of 5 GB each. Also keepi

Re: IGFS: Writing to a nonexistent file: "Failed to append to the file due to secondary file system exception"

2016-02-19 Thread Vladimir Ozerov
Kobe, Append and create operations cannot use the same code path since append operation require some additional synchronization between primary and secondary file systems. Anyway, the problem is known and will be fixed. Vladimir. On Thu, Feb 18, 2016 at 8:24 PM, Kobe <r...@mailcity.com>

Re: changed cache configuration and restarted server nodes. Getting exception.

2016-02-19 Thread Vladimir Ozerov
assistance from your side with it? Any more hints - XML configuration, simplified code sample to reproduce the issue, etc. are appreciated. Vladimir. On Fri, Feb 19, 2016 at 6:32 PM, vinshar <vinsharma.t...@gmail.com> wrote: > Thanks for workaround Vladimir. I am using multiple caches. Each

Re: storekeepbinary error?

2016-02-29 Thread Vladimir Ozerov
Ravi, Probably you have old Ignite version where there is no such method. Vladimir. On Tue, Mar 1, 2016 at 10:02 AM, Ravi Puri <ravikumarpur...@gmail.com> wrote: > <http://apache-ignite-users.70518.x6.nabble.com/file/n3284/storebinary.png > > > > how to resolve above

Re: About fetch cache data's question

2016-02-29 Thread Vladimir Ozerov
If you stop one Tomcat/Ignite instance, then all data will be available still on remaining two instances. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/About-fetch-cache-data-s-question-tp3281p3282.html Sent from the Apache Ignite Users mailing list archive at

Re: QueryCursor entry does not return "versioned" cache entry.

2016-02-29 Thread Vladimir Ozerov
returned by query cursor and expect these updates to be as a part of transaction. I would recommend the following approach: 1) Run SQL query and identify the list of key to be updated. 2) Start transaction and update these keys using IgniteCache.get() and IgniteCache.put() operations. Vladimir

Re: update the sql database after a particular limit?

2016-02-29 Thread Vladimir Ozerov
you want to change database data, update the cache, not the database. Ignite will transfer this change to the database. Vladimir. On Tue, Mar 1, 2016 at 8:32 AM, Ravi Puri <ravikumarpur...@gmail.com> wrote: > Suppose i have a employee data and its login time . I want to fetch the >

Re: @QuerySqlField for collections

2016-03-10 Thread Vladimir Ozerov
public String strP; @QuerySqlField(index = true) public int intP; @QuerySqlField(index = true) public Double doubleP; @QuerySqlField(index = false) public List listP; } This leads me to assumption that this is a kind of Spark- or Scala-specific problem. *Andrey Gura, * Could you ple

Re: CacheStore handles persistence in client node for transactional cache

2016-03-10 Thread Vladimir Ozerov
guarantees, so it can perform writes to store from primary nodes and hence store is never invoked from clients. You can disable saves from client if you enable write-behind semantics. See CacheConfiguration.writeBehindEnabled property. Vladimir. On Thu, Mar 10, 2016 at 12:32 PM, knowak

Re: Off Heap cache using lots of heap memory

2016-03-10 Thread Vladimir Ozerov
Hi Neil, Could you please attach the code reproducing the problem? Vladimir. On Wed, Mar 9, 2016 at 1:16 PM, Neil Wightman <neil_wight...@intergral.com> wrote: > Hi All, > > I have been trying out ignite for the past few weeks but I am hitting a > strange problem. I dont kn

Re: about mr accelerator question.

2016-03-18 Thread Vladimir Ozerov
and we will be able to give you more ideas on what to do. Vladimir. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/about-mr-accelerator-question-tp3502p3552.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Off Heap cache using lots of heap memory

2016-03-15 Thread Vladimir Ozerov
Hi Neil, Thank you for code snippet. I was able to reproduce the problem and created a ticket - https://issues.apache.org/jira/browse/IGNITE-2833 Hope we will be able to fix it soon. Vladimir. On Fri, Mar 11, 2016 at 10:13 AM, Neil Wightman <neil_wight...@intergral.com > wrote: > Hi

Re: Ignite Cache and Compute Performance

2016-03-31 Thread Vladimir Ozerov
. Instead, it is better to fix ScanQuery issues. Vladimir. On Thu, Mar 31, 2016 at 3:09 AM, abarbaro <abarb...@powercosts.com> wrote: > Vladimir and Ignite Community > > I'm attaching my source code and results for tests comparing the > performance > of ScanQuery

Re: spark and ignite - possibilities

2016-04-13 Thread Vladimir Ozerov
emails). All you need to do is send an email to “ user-subscr...@ignite.apache.org” and follow simple instructions in the reply. Vladimir. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/spark-and-ignite-possibilities-tp4055p4120.html Sent from the Apache Ignite

Re: How to solve the data lost?

2016-03-19 Thread Vladimir Ozerov
Hi, Can you please properly subscribe to the mailing list so that the community receives email notifications? Follow the instruction here: http://apache-ignite-users.70518.x6.nabble.com/mailing_list/MailingListOptions.jtp?forum=1 I am not sure I understand your question. Do you want to loose

Re: Re: about mr accelerator question.

2016-03-24 Thread Vladimir Ozerov
something. One possible change you can make to your config - switch temporal file system paths used by your jobs to PRIMARY mode. This way all temp data will reside only in memory and will not hit HDFS. Vladimir. On Wed, Mar 23, 2016 at 8:48 AM, l...@runstone.com <l...@runstone.com> wrote: >

Re: @QuerySqlField for collections

2016-03-04 Thread Vladimir Ozerov
Hi DmitryB, Could you please provide the full class name of "List"? Is it java.util.List or some Scala collection? Can you try putting java.util.ArrayList and see if it works? Vladimir. On Fri, Mar 4, 2016 at 6:59 AM, DmitryB <ifi...@yandex.ru> wrote: > Hi team, >

Re: What will happen when one ignite node down and cache mode is Partitioned

2016-03-01 Thread Vladimir Ozerov
Ignite will re-balance data between remaining nodes. On Tue, Mar 1, 2016 at 2:03 PM, 上帝已死 <527901...@qq.com> wrote: > What will happen when one ignite node down and cache mode is Partitioned > > > > -- > View this message in context: >

Re: About cache backups's question

2016-03-02 Thread Vladimir Ozerov
You have replicated cache, and backup setting doesn't have sense in this mode because data will be replicated to all nodes in topology. On Wed, Mar 2, 2016 at 9:03 AM, 上帝已死 <527901...@qq.com> wrote: > When I set backups = 1, the output still is backups=2147483647 > > > > -- > View this message

Re: What will happen when one ignite node down and cache mode is Partitioned

2016-03-02 Thread Vladimir Ozerov
REPLICATED cache doesn't scale well in terms of memory consumption because each node will have the full set of data. So in general it is recommended to user PARTITIONED cache with several backups. On Wed, Mar 2, 2016 at 5:24 AM, 上帝已死 <527901...@qq.com> wrote: > I use nginx to do load balancing

Re: Ignite terminology

2016-03-28 Thread Vladimir Ozerov
t;, true); Ignition.start([config with gridName="A"]); Ignite after = Ignition.ignite("A"); assert before == after; // Will fail. Vladimir. On Sat, Mar 26, 2016 at 12:04 AM, alexGalushka <alexander.galus...@emc.com> wrote: > Hello Ignite community! > >

Re: Error Starting Node from .net

2016-03-28 Thread Vladimir Ozerov
Java node: Vladimir. On Mon, Mar 28, 2016 at 3:21 AM, Murthy Kakarlamudi <ksa...@gmail.com> wrote: > Hi, >In my application, I am starting the node from command line. One the > client nodes uses java to load the data and the other client node in .net > uses sql to query the c

Re: HDFS as persistent store for data grid

2016-03-28 Thread Vladimir Ozerov
/in-memory-file-system Vladimir. On Mon, Mar 28, 2016 at 8:23 AM, Kushal Kumaran <kus...@locationd.net> wrote: > Hi, > > The page at https://ignite.apache.org/features/datagrid.html mentions > that "Ignite can automatically integrate with external databases - > RDBMS, NoSQL,

Re: SqlQuery Error

2016-03-29 Thread Vladimir Ozerov
Hi Tony, It looks like you should use "Test*t*able1", not "Test*T*able1". Vladimir. On Mon, Mar 28, 2016 at 4:46 PM, 16616...@qq.com <16616...@qq.com> wrote: > hi yakov, > > Thank you very much for you reply. > Now I can execute sql query and field

Re: get a Affinity interface

2016-03-29 Thread Vladimir Ozerov
Hi Shaomin, This method is located on *Ignite* interface. Vladimir. On Tue, Mar 29, 2016 at 1:26 PM, Shaomin Zhang <shaomin.zh...@tudor.com> wrote: > Hi > > > > I am trying to get an Affinity interface to get node/partition/key > information. The Java doc page says yo

Re: Ignite Cache and Compute Performance

2016-03-29 Thread Vladimir Ozerov
* and it's ability to scan particular cache partitions (method *ScanQuery.setPartition()*). See *CacheQueryExample*. Please let me know if you need any further assistance. Vladimir. On Tue, Mar 29, 2016 at 12:33 AM, abarbaro <abarb...@powercosts.com> wrote: > Hello Ignite Commu

Re: Host Arrays in C++ API

2016-03-28 Thread Vladimir Ozerov
Hi Arthi, I think first of all we should understand how much time is spent on query itself and how much time is spent on deserialization. Yoo already provided XML configuration. Could you please also provide your CPP classes, your code to query Ignite and SQL query itself? Vladimir On Mon, Mar

Re: Automatic Persistence in .NET

2016-03-30 Thread Vladimir Ozerov
and is currently available only in Java. Please let me know if you have any further questions. Vladimir. On Wed, Mar 30, 2016 at 6:05 AM, Murthy Kakarlamudi <ksa...@gmail.com> wrote: > Hi, >Our .NET application needs read-through and write-through capabilities. > I see that the

Re: Ignite Cache and Compute Performance

2016-03-30 Thread Vladimir Ozerov
Hi Andres, Scan query with partition number was created exactly to iterate over partitions. Please share your numbers for scan query and local iteration. For now I do not see any obvious reason why it could be much slower than iteration. Vladimir. On Wed, Mar 30, 2016 at 2:03 AM, abarbaro

Re: Ignite Data Grid with write through mode to HDFS with layer of IGFS

2016-04-13 Thread Vladimir Ozerov
Vij, No, it doesn't. IGFS serves the very different purpose - it is Hadoop-compatible file system. It means that, for example, you can load data to IGFS and then query it using Hive. But native Ignite SQL is not applicable here. Vladimir. On Wed, Apr 13, 2016 at 3:55 PM, vijayendra bhati

Re: Not able to save data in Ignite datagrid using JavaIgniteRDD

2016-04-25 Thread Vladimir Ozerov
Hi Vij, I am a bit confused - do you still have any problems? Because one message earlier you mentioned that finally it worked. Is any assistance still needed? Vladimir. On Thu, Apr 21, 2016 at 7:32 AM, vijayendra bhati <veejayend...@yahoo.com> wrote: > Hi Alexei, > > Here

Re: Error running nodes in .net and c++

2016-04-25 Thread Vladimir Ozerov
. Vladimir. On Mon, Apr 25, 2016 at 5:32 PM, Murthy Kakarlamudi <ksa...@gmail.com> wrote: > Any help on this issue please... > > On Sat, Apr 16, 2016 at 7:29 PM, Murthy Kakarlamudi <ksa...@gmail.com> > wrote: > >> Hi, >>In my use case, I am starting a node from .

Re: Performance Issue - Threads blocking

2016-04-22 Thread Vladimir Ozerov
Hi, Could you please explain why do you think that the thread is blocked? I see it is in a RUNNABLE state. Vladimir. On Fri, Apr 22, 2016 at 2:41 AM, ccanning <ccann...@stubhub.com> wrote: > We seem to be having some serious performance issues after adding Apache > Ignite Local

Re: Ignite cache data size problem.

2016-04-22 Thread Vladimir Ozerov
and value model classes and your XML configuration to investigate it further? Vladimir. On Fri, Apr 22, 2016 at 2:02 PM, Zhengqingzheng <zhengqingzh...@huawei.com> wrote: > Hi there, > > I am trying to load a table with 47Million records, in which the data size > is less than 3g

Re: Ignite Installation with Spark under CDH

2016-04-29 Thread Vladimir Ozerov
Hi Michael, Ok, so it looks like the process didn't have enough heap. Thank you for your inputs about CDH configuration. We will improve our documentation based on this. Vladimir On Thu, Apr 28, 2016 at 5:15 PM, mdolgonos <michael.dolgo...@citi.com> wrote: > Vladimir, &g

Re: Issue with Java 8 datatype LocalDate while using IgniteRDD

2016-04-29 Thread Vladimir Ozerov
Hi Vij, Do you see any exception or some other kind of error? Please provide more error description. Vladimir. On Fri, Apr 29, 2016 at 2:47 PM, vijayendra bhati <veejayend...@yahoo.com> wrote: > Hi Guys, > > I am trying to store a object which contains object of type Local

Re: Affinitykey is not working

2016-04-29 Thread Vladimir Ozerov
Hi, Could you please explain how do you detect a node to which key is mapped? Do you use Affinity API? Vladimir. On Fri, Apr 29, 2016 at 11:48 AM, nikhilknk <nikhil...@gmail.com> wrote: > I used the below ToleranceCacheKey as the key . I want to keep all the > keys > whose

Re: Number of partitions of IgniteRDD

2016-04-29 Thread Vladimir Ozerov
od, so it should return actual number of partitions. "getPartitions" returns array, could you please show is printed to the console from your code? Vladimir. On Fri, Apr 29, 2016 at 3:10 PM, vijayendra bhati <veejayend...@yahoo.com> wrote: > Yes its Spark RDD's standard

Re: Ignite Installation with Spark under CDH

2016-04-26 Thread Vladimir Ozerov
and scripts where you added Igntte JARs and/or your jar-with-dependencies? Vladimir. On Tue, Apr 26, 2016 at 12:43 AM, mdolgonos <michael.dolgo...@citi.com> wrote: > Vladimir, > There are 2 things that I'm experiencing so far: > 1. I have added the following code to spark-env.sh in my C

Re: Detecting a node leaving the cluster

2016-04-26 Thread Vladimir Ozerov
into separate thread or thread pool. Vladimir. On Mon, Apr 25, 2016 at 2:54 PM, Ralph Goers <ralph.go...@dslextreme.com> wrote: > Great, thanks! > > Is listening for that the way you would implement what I am trying to do? > > Ralph > > On Apr 25, 2016, at 4:22 AM, Vladimir O

Re: Error running nodes in .net and c++

2016-04-26 Thread Vladimir Ozerov
Hi Murthy, Seems that you faced a kind of usability issue, which happens only in some specific cases. Please try replacing the following line in your config: with this: It should help. Vladimir. On Tue, Apr 26, 2016 at 1:36 AM, Murthy Kakarlamudi <ksa...@gmail.com> wrote: >

Re: Ignite cache data size problem.

2016-04-26 Thread Vladimir Ozerov
be *IgniteCache.loadlCache*, or *IgniteCache.put*? Vladimir. On Tue, Apr 26, 2016 at 3:01 PM, Zhengqingzheng <zhengqingzh...@huawei.com> wrote: > Hi Vladimir, > > Thank you for your help. > > I tried to load 1Million records, and calculate each object’s size > (includ

Re: Ignite cache data size problem.

2016-04-26 Thread Vladimir Ozerov
Hi Kevin, Yes, log files are created under this directory by default. Vladimir. On Tue, Apr 26, 2016 at 3:18 PM, Zhengqingzheng <zhengqingzh...@huawei.com> wrote: > Hi Vladimir, > > No problem. > > I will re-run the loading process and give you the log file. > > To

Re: Error running nodes in .net and c++

2016-04-26 Thread Vladimir Ozerov
HI Murthy, Do you start all nodes with the same XML configuration? Please ensure that this is so, and all nodes know all caches from configuration in advance. Vladimir. On Tue, Apr 26, 2016 at 3:27 PM, Murthy Kakarlamudi <ksa...@gmail.com> wrote: > Hi Vladimir...I made the update

Re: Ignite cache data size problem.

2016-04-27 Thread Vladimir Ozerov
. Vladimir. On Wed, Apr 27, 2016 at 1:52 PM, Zhengqingzheng <zhengqingzh...@huawei.com> wrote: > Thank you Vladimir, > > I will try to use the second recommendation first, and let you know the > result asap. > > > > I thought more nodes will result in fast data loading

Re: Gar file gives me java.lang.ClassNotFoundException

2016-04-27 Thread Vladimir Ozerov
Hi, Please provide the full stack trace and (if possible) code to reproduce the problem. Vladimir. On Wed, Apr 27, 2016 at 9:26 AM, mortias <mort...@telenet.be> wrote: > Hi all, > > I'm trying to use a gar file to deploy my project however I get a > java.lang.Clas

Re: Affinity Collocation

2016-04-27 Thread Vladimir Ozerov
Hi, There should not be any problems with config like this because all Organization entries will be located on all nodes in the cluster. Vladimir. On Wed, Apr 27, 2016 at 9:47 AM, Kamal C <kamaltar...@gmail.com> wrote: > What do you mean by cache configuration? > > If I go

Re: Ignite Installation with Spark under CDH

2016-04-27 Thread Vladimir Ozerov
Hi Michael, Could you please print resulting value of the SPARK_CLASSPATH variable? Vladimir. On Tue, Apr 26, 2016 at 8:55 PM, mdolgonos <michael.dolgo...@citi.com> wrote: > Vladimir, > I verified that the cache jar is in the Cloudera jars directory. All the > cache packages ar

Re: Caused by: class org.apache.ignite.binary.BinaryInvalidTypeException:

2016-04-27 Thread Vladimir Ozerov
Hi. Yes, normally computations are performed on both primary and backup nodes. Vladimir. On Wed, Apr 27, 2016 at 10:19 AM, kcheng.mvp <kcheng@gmail.com> wrote: > Saying cache mode is "PARTITIONED", in this case both primary node and > backup > nodes would execu

Re: ignite nodes close exception when using cache -clear -c=@c7

2016-04-27 Thread Vladimir Ozerov
Hi Kevin, Looks like the topology got broken for some reason. Could you please attach logs from all nodes so that I can investigate it deeper? Vladimir. On Wed, Apr 27, 2016 at 1:46 PM, Zhengqingzheng <zhengqingzh...@huawei.com> wrote: > Hi there, > > When I tried to clear one

  1   2   3   >