Re: Get distributed query data from Ignite local caches in cluster

Hi, Local mode is different to other modes. 1. Local cache can be accessed from node where cache has been created. So, you can't access NodeA local cache from NodeB. 2. If you create Local cache on client then this cache will be located on client while Partitioned or Replicated caches always

Re: Re[4]: Faceted search

icSearch to store and > get entities; >2.) Store entities using ElasticSearch in CacheStore and > query them without usage of Ignite. > >What are the advantages of the first option? > > -- > Best Regards, > Mikhail > > Четверг, 19 янв

Re: How to remove large amount of data from cache

Hi, 1. Why do you need HashSet here? It looks like you can remove entry in-place without iterating over hashset. 2. Is this code running in transaction? If you use ignite 1.8, you can run "Delete * from table ..." query. See http://apacheignite.gridgain.org/docs/dml#section-delete On Wed, Jan

Re: Efficient way to get partial data of a cache entry

Hi Shawn, #1 way is most unefficient way to get entry by the known key, due to SQL parsing and planning overhead. #2 way can cause unwanted deserialization in case of big value objects. #3 way look like the most efficient way if you need the only field or few fields of big value object.

Re: Cache Metrics

Hi Alper, May be it is not obvious, but to enable offheap you need to setOffheapMaxMemory to zero (unlimited) or above zero. Also metrics is disabled by default, you need call setStatisticsEnabled(true); On Tue, Dec 20, 2016 at 11:41 AM, Alper Tekinalp wrote: > Hi all. > > I

Re: Binary Marshalling issue

> Thanks for your response. Is there a way I can disable it or reduce it? Do > I need to use BinaryObject? > > > > Thanks, > > Pradeep V.B. > > > > *From:* Andrey Mashenkov [mailto:andrey.mashen...@gmail.com] > *Sent:* Friday, December 16, 2016 9:41 AM > *To:

Re: Binary Marshalling issue

Hi As I understand you have many short-lived Maps as values in cache. Yes, in your case, you can get a lot of garbage due to Map will be marshal\unmarshal along with each of its content at every cache entry access. On Fri, Dec 16, 2016 at 4:26 PM, Pradeep Badiger wrote:

Re: How to save odd number objects on one node and even number objects on another node

Hi Rishi, Yes, you can do this by implementing your own AffinityFunction and then add it to CacheConfiguration with CacheConfigucation.setAffinity(..) method. On Fri, Dec 16, 2016 at 12:34 AM, rishireddy.bokka < rishireddy.bo...@gmail.com> wrote: > Hi Ignite Team, > I recently started using

Re: 答复: 答复: query binaryobject cache in zeppelin

mn names, zeppelin can show the data. > > > > Also some background about the testing: > > > > Using ignite 1.8 and zeppelin 0.6.2. in order to make zeppelin work with > ignite 1.8, I had to build from source and change pom.xml to use ignite > 1.8.0. > >

Re: 答复: query binaryobject cache in zeppelin

String> fields = new LinkedHashMap<>(); > List indexes = new ArrayList<>(); > for (ColumnScheme columnScheme : columns) > { > fields.put(columnScheme.getName(), columnScheme.getType()); > if (columnScheme.isEnsureIndex()) > { > indexes.add(new Q

Re: query binaryobject cache in zeppelin

Hi Shawn, Classes that you want to use in queries should be set via setQueryEntities. *Table name* in Ignite has name of type. E.g if you want to get some record of class "my.org.Person" you should use "Person" as table name: Select * from Person. To make cross cache query you should use full

Re: Is it possible to create a near cache without any copy on servers nodes?

Hi Yuci, Yes, you are right. On Tue, Dec 6, 2016 at 7:30 PM, yucigou wrote: > Hi Alexey, > > Thank you. So my understanding of client nodes was wrong. > > The correct understanding should be: if I start a node as client node, and > a > cache created by the client node is

Re: How caches in Local Mode works?

Hi, Node B will never see local cache of Node A. LocalMode means that cache is accessible only from node it was created on. On Tue, Dec 6, 2016 at 5:56 PM, yucigou wrote: > Suppose I have two server nodes in the cluster, both nodes have all caches > in > Local Mode. > >

Re: Is it possible to create a near cache without any copy on servers nodes?

Hi, It seems you are looking for LocalCache. See [1] for details [1] http://apacheignite.gridgain.org/docs/cache-modes#local-mode On Tue, Dec 6, 2016 at 5:29 PM, yucigou wrote: > According to the documentation > http://apacheignite.gridgain.org/docs/near-caches, a Near

Re: Building complex queries to query ignite Cache

Hi, You can try to add index with setting: cacheConfig.setIndexedTypes(Integer.class, Trade.class); and annotate "status" field with @QuerySqlField(index = true) Then you will be able to make sql query with grouping, smth like: "select count(*) from Trade group by status; If you need to group

Re: Persistent Store & Ignite Streamer

Hi Labard, This is default behavior of data streamer. By default, data streamer won't rewrite data on store. It useful if u fill cache with data from the store that cache backed by. See link [1] for more information. [1]

Re: MapReduce Job stuck when using ignite hadoop accelerator

Hi Kaiming, ^-- Public thread pool [active=80, idle=0, qSize=944] There are long queue and 80 busy threads that seemd do no progress. It looks like all of threads are blocked. Please, attach a thread-dump. On Tue, Nov 29, 2016 at 6:40 AM, Kaiming Wan <344277...@qq.com> wrote: > I can find the

Re: Objects in heap dump corresponding to binary and de-serialized version of entries

Hi, GridDhtAtomicCacheEntry represents cache entry. BinaryObject represents serialized objects: entry keys and entry values. GridH2ValueCacheObject, GridH2KeyValueRowOnHeap are index internal objects. On Thu, Dec 1, 2016 at 10:13 AM, rishi007bansod wrote: > I have

Re: Setting Server Node Heap Size in Java

Hi Vaibhav, Java heap size can only be set via startup options -Xms and -Xmx. On Fri, Nov 25, 2016 at 1:45 PM, vaibhav sharma < vaibhav.dutt.sha...@gmail.com> wrote: > Hi All, > > I am starting a ignite server node via Java and observed that it spins out > with default 0.5 GB on heap size. > >

Re: Cache Memory Behavior \ GridDhtLocalPartition

see wither forcing a GC will clean the memory. > > Thank you for ur help > > On Fri, Nov 11, 2016 at 11:59 AM, Andrey Mashenkov < > amashen...@gridgain.com> wrote: > >> Hi Isaeed Mohanna, >> >> I don't see any eviction or expired policy configured. Is

Re: Hive job submsiion failed with exception ”java.io.UTFDataFormatException“

Hi lapalette, Would you like to explain the way you have change Marshaller? It seems OptimizedMarshaler does not have these limitations, and its possible it was not configured in correct way. On Fri, Nov 11, 2016 at 4:30 PM, Andrey Mashenkov <amashen...@gridgain.com> wrote: > Hi

Re: Hive job submsiion failed with exception ”java.io.UTFDataFormatException“

Hi lapalette, 1. Does this error appears in ignite 1.7 and it's not present in version 1.6? 2. Did you get same error with another marshallers? Would you please provide stacktraces with other marshallers? 3. What version of JVM do you use? Have you try to upgrade JVM? So, its JDK internals

Re: Very high memory consumption in apache ignite

Hi rishi007bansod. Are you sure all these memory consumped with java process? You can try to analyze pmap or vmmap tool report? https://plumbr.eu/ blog/memory-leaks/why-does-my-java-process-consume-more-memory-than-xmx Please, let me know if you find any suspicious thing. On Thu, Nov 10, 2016

Re: Cache Memory Behavior \ GridDhtLocalPartition

; failedEventsCacheConfig.setIndexedTypes(UUID.class, EventEntity.class); > failedEventsCacheConfig.setBackups(1); > failedEventsCacheConfig.setOffHeapMaxMemory(0); > > // In addition i have one atomic reference > AtomicConfiguration atomicCfg = new AtomicConfiguration(); > atomicCfg.setCacheM

Re: Hive job submsiion failed with exception ”java.io.UTFDataFormatException“

Hi lapalette, There is a limitation in ObjectOutputStream, it fails to write UTF strings longer than 65k bytes. Have you try to use another marshaller? https://ignite.apache.org/releases/1.7.0/javadoc/index.html?org/apache/ignite/marshaller/Marshaller.html On Thu, Nov 10, 2016 at 6:20 AM,

Re: ignite-spring conflict

It looks like, now you run out of memory. You can try to increase heap memory size. Please, attach full stacktrace, so one can see if there is another possible issue. On Thu, Nov 10, 2016 at 11:54 AM, ewg wrote: > Yeah, that was the problem. We use spring.version

Re: Cache Memory Behavior \ GridDhtLocalPartition

Hi Isaeed Mohanna, Would you please provide your cache configurations? On Wed, Nov 9, 2016 at 5:37 PM, Isaeed Mohanna wrote: > Hi > i have an ignite 1.7.0 cluster with 3 nodes running , i have 3 PARTITIONED > ATOMIC CACHES and 2 REPLICATED ATOMIC CACHES, Most of these caches

Re: 答复: 答复: ignite used too much memory

a reproducer. On Thu, Oct 27, 2016 at 10:29 AM, Shawn Du <shawn...@neulion.com.cn> wrote: > Hi Andrey Mashenkov, > > > > I checkout pr/1101 pr/1037 and have a test both of them. Things maybe go > better but not resolved. > > > > This is my cache state

Re: Null column values - bug

ode i see in the JdbcResultSet. val is not null for null values > for string types. then val == null is false. correct ? > > T val = cls == String.class ? (T)String.valueOf(curr.get(colIdx - 1)) : > (T)curr.get(colIdx - 1); > > wasNull = val == null; > > On 3 November 2016 at

Re: Null column values - bug

is false all the time for string types. correct ? > > On 3 November 2016 at 20:39, Andrey Mashenkov <amashen...@gridgain.com> > wrote: > >> Javadoc says that null value should be returned. >> >> But from the other side, there is wasNull() method, that should be us

Re: Null column values - bug

Javadoc says that null value should be returned. But from the other side, there is wasNull() method, that should be use for null checks. On Thu, Nov 3, 2016 at 5:39 PM, Andrey Gura wrote: > String.valuOf(null) return "null" string by contract. > > On Thu, Nov 3, 2016 at

Re: 答复: ignite used too much memory

Hi, Shawn Du It seems you faced next 2 bugs. First bug: High memory utilization using OffHeap with ExpirePolicy. Issue has a fix, but it is not merged to master yet. See: https://issues.apache.org/jira/browse/IGNITE-3840. Second bug: TTL Manager continue track evicted (and removed) entries,

<    1   2   3   4   5   6