Re: Help with tuning for larger clusters

2015-10-27 Thread Denis Magda
Denis Magda <dma...@gridgain.com>: Hi Joe, How big is a port range, that you specified in your discovery configuration, for a every single node? Please take into account that the discovery may iterate over every port from the range before one node connects to the other and depending on t

Re: Container-Managed Transactions (CMT) and Ignite

2015-10-29 Thread Denis Magda
Hi Juan, To integrate with some JTA manager you need to implement org.apache.ignite.cache.jta.CacheTmLookup. The interface returns an instance of a particular TransactionManager to use. Ignite has two implementation of this interface out of the box - CacheJndiTmLookup and

Re: Help with tuning for larger clusters

2015-10-29 Thread Denis Magda
. On Wed, Oct 28, 2015 at 7:04 AM, Denis Magda <dma...@gridgain.com <mailto:dma...@gridgain.com>> wrote: Hi Joe, No problems, I'll guide you until we get to the bottom. Do you start pre-loading the caches with data right after the cluster is ready? If so let's po

Re: Write-behind question

2015-11-12 Thread Denis Magda
Hi Andrew, This is a known issue and it should be fixed by the end of the year. Can anyone provide Andrew with a corresponding JIRA ticket? I didn't manage to find it. -- Regards, Denis On 11/12/2015 9:25 AM, Andrew wrote: Hello, I got a question while I'm testing write-behind. I'm using

Re: Cache startSize tunning

2015-11-12 Thread Denis Magda
Hi, Please see below... On 11/13/2015 7:07 AM, diopek wrote: Below is one use case; Step 1, I get a handle to cache already configured in one common cache configuration xml file Step 2, flush the cache in case it is full Step 3, populate regular Java LinkedHashMap from one DB Step 4, add that

Re: Data Loading Performance Issue

2015-11-15 Thread Denis Magda
Hi, Do you use the DB mentioned below as a persistent storage for the Ignite Cache being populated? If yes, then you can leverage CacheStore interface [1]. If otherwise you migrate your data from the DB then IgniteDataStreamer is the best candidate for such kind of tasks. It’s not clear from

Re: how to search specific value in some specific tag in xml using GridGain

2015-11-09 Thread Denis Magda
Hi, First of all please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send an email to “ user-subscr...@ignite.apache.org” and follow simple instructions in the reply. Next, to be honest I don't see how you can leverage

Re: Does IgniteCache.withExpiryPolicy affect existing cache entries?

2015-11-09 Thread Denis Magda
Hi Kevin, First of all please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send an email to “ user-subscr...@ignite.apache.org” and follow simple instructions in the reply. > cache.withExpiryPolicy(new

Re: Help required to optimize Ignite Cache settings to be used 'LOCAL' only mode

2015-11-09 Thread Denis Magda
Hi, Can you please subscribe to the mailing list so that we receive email notification for your posts? You can refer to this instruction: http://apache-ignite-users.70518.x6.nabble.com/mailing_list/MailingListOptions.jtp?forum=1 Regarding your question. Are you saying that you gonna have only

Re: IGFS backed by persistence on physical filesystem

2015-11-09 Thread Denis Magda
Hi, You can use IGFS as Hadoop Accelerator. Hadoop will persist your date. There is a starting guide for this configuration: https://apacheignite.readme.io/docs/file-system Regards, Denis -- View this message in context:

Re: OutOfMemoryError with Hadoop backing filesystem

2015-11-09 Thread Denis Magda
Hi, Since IGFS is used as a secondary file system for Hadoop you can enable eviction policy for IGFS. IgfsPerBlockLruEvictionPolicy has two parameters - maxSize and maxBlocks. When any parameter exceeds the policy will evict last recently used data from the memory. When previously evicted data

Re: Disk Secondary FileSystem

2015-11-09 Thread Denis Magda
Hi, Presently IGFS supports only Hadoop as a persistent storage out of the box. As far as I know Hadoop shouldn't consume much of RAM and OutOfMemoryError (OOM) you're getting most likely to happen because of IGFS that stores too much data and there is no more physical memory available on your

Re: Help with tuning for larger clusters

2015-11-02 Thread Denis Magda
Joe, Thanks for the clarifications. Now we're on the same page. It's great that the cluster is initially assembled without any issue and you see that all 64 joined the topology. In regards to 'rebalancing timeout' warnings I have the following thoughts. First, I've opened a bug that describes

Re: Does Ignite support SQL statement of "INSERT"?

2015-11-04 Thread Denis Magda
Hi, Presently only "SELECT" operator is supported by Ignite. I heard that we are planning to support "INSERTS". Igniters, correct me if I'm wrong. -- Denis -- View this message in context:

Re: Getting a list of started caches

2015-11-04 Thread Denis Magda
FYI, The feature is implemented and will be available in the nearest release. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Getting-a-list-of-started-caches-tp876p1839.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: The result of cross-cache SQL joins is incomplete.

2015-11-02 Thread Denis Magda
> There is another question, when I put table data into REPLICATED cache, This operation is synchronous or asynchronous? cache.put is synchronous. However, you can make behave him asynchronously this way: cache.withAsync().put(...) > If it is asynchronous, how can I know when this operation has

Re: The result of cross-cache SQL joins is incomplete.

2015-11-02 Thread Denis Magda
> I compared the SQL querys between yours and mine, and I found something different. > For your SQL query "emp.depid = dep.id", dep.id is primary key of table > Department. > But for my SQL query "A.mid = B.mid", B.mid is NOT primary key of table B. Actually, I've provided you with the example

Re: IP based discovery, dynamic nodes, and start() deadlock

2015-11-02 Thread Denis Magda
Hi Erik, Discovery logic works the same for any kind of IP finders. IP finder is just a way to pass a list of TCP/IP addresses to use during the time a node joins a cluster. Muticast IP finder forms such a list automatically for you while in case of static IP finder you do this manually. If you

Re: Distributed queue problem with peerClassLoading enabled

2015-11-02 Thread Denis Magda
Hi Mateusz, Seems that either PRIVATE or ISOLATED deployment mode perfectly fits for your task. Please try to switch to one of them. CONTINUOUS mode reloads previously deployed classes only when 'userInfo' changes. Refer to the documentation of this node. In short to fix this you should increase

Re: Data Loading Performance Issue

2015-11-16 Thread Denis Magda
Hi, Unfortunately I can't give you concrete recommendations because there are tons of the reasons why your loading takes so long time. Please clarify the following: 1) How big is the data set you're preloading? 2) What is your grid configuration? How many nodes are there? Attache Ignite

Re: Can anyone hear me?

2015-08-28 Thread Denis Magda
Yeap, you're not alone here. Subscribed successfully. On 8/28/2015 11:39 AM, endian675 wrote: Subscribing to this list is really too awkward, multiple steps that don't seem to work as described. -- View this message in context:

Re: Can't return lambda when peer class loading

2015-09-09 Thread Denis Magda
cate = predicate; } } On 8 September 2015 at 14:20, Denis Magda <dma...@gridgain.com <mailto:dma...@gridgain.com>> wrote: Please, see below On 9/8/2015 4:03 PM, Sam Adams wrote: Hi, I have peer class loading enabled in my XML config: I assume

Re: Storing Time Series data efficiently on Ignite

2015-12-03 Thread Denis Magda
Hi Welly, Ignite perfectly fits for your task. First, if I understand you properly there are will be many time series for a give sensor ID. If so then I would use a compound key like (sensorId, time) for all cache related operations. As an example you may want to use classes like this.

Re: Grid stopped with IgniteCheckedException: Failed to deserialize object with given class loader: sun.misc.Launcher$AppClassLoader

2015-12-02 Thread Denis Magda
Hi, Actually I don't see an actual error from the logs provided by you that had caused an abnormal behavior on your side. DEBUG messages related to communication issues are normal. They tend to appear when a connection to an expected node is lost or can't established by some reason. The only

Re: From one cache to another

2015-12-06 Thread Denis Magda
Hi, Actually if a processor is being deployed on a remote node all other classes, the processor refers to from its code, are deployed as well. In my understanding you should take into account the deployment mode that is used on your side. By default SHARED mode is activated which means for

Re: Help for Loading data from oracle database to Ignite cache

2015-12-09 Thread Denis Magda
Hi, If you're planning to sync data back to Oracle DB from a cache than I would suggest you setting up Oracle DB as a persistent store. Once setup you can use IgniteCache.loadAll/loadLocal to prefill a cache with data. Please refer to these articles for detailed explanation - [1] and [2] On the

Re: Continuous update Data Grid Cache

2015-12-09 Thread Denis Magda
Hi fsapei, Actually you need to extend functionality that is located in org.apache.ignite.internal.jdbc2 package or org.apache.ignite.internal.jdbc in case you work with a legacy version of Ignite JDBC Driver. In particular you can start looking at

Re: Need to effect cache at time of changes made in database

2015-12-09 Thread Denis Magda
Hi Kamesh, There is no way to trigger Ignite cache when an update happens at a database layer. You should either - periodically use some predicate in conjunction with IgniteCache.loadAll in order to load data from DB; or - make the other app to do updates through the cache. Does any of

Re: Need to effect cache at time of changes made in database

2015-12-10 Thread Denis Magda
Hi Kamesh, I general you solution should work fine. I've not noted any issue in your code snippet. Optionally, you may want try to reuse CacheLoadOnlyStoreAdapter. It should work faster than your implementation. There are no any special examples for CacheLoadOnlyStoreAdapter. However, you can

Re: Links for binaries on downloads site, incorrect.

2015-12-14 Thread Denis Magda
Please choose a particular mirror from "Selected mirror" dropdown list. We will fix this bug shortly, please pointing out to it. On 12/14/2015 1:35 PM, mikep wrote: https://ignite.apache.org/download.html#binaries links to:

Re: Links for binaries on downloads site, incorrect.

2015-12-14 Thread Denis Magda
BTW, Could you tell us where did you find an UI element that has this link: https://ignite.apache.org/download.html#binaries We're unable to find such on our site. -- Denis On 12/14/2015 1:55 PM, Denis Magda wrote: Please choose a particular mirror from "Selected mirror" dropdown

Re: .Net support

2015-12-17 Thread Denis Magda
Hi, Starting from Ignite 1.5 .Net and C++ are officially supported. You can refer to .Net documentation for more details: https://apacheignite-net.readme.io/ BTW, please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send

Re: How to define LocalEvent without setting

2015-12-17 Thread Denis Magda
Hi Alex, If I understand you properly you want to listen to different system events that happen on remote and local nodes. In such a case I would suggest you referring to the following example

Re: unsubscribe

2015-12-17 Thread Denis Magda
Hi Andrea, To unsubscribe from this mailing list you have to send a message to this email address "user-unsubscr...@ignite.apache.org" -- Denis -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/unsubscribe-tp2237p2247.html Sent from the Apache Ignite Users

Re: Links for binaries on downloads site, incorrect.

2015-12-14 Thread Denis Magda
The wrong link was in the navigation bar of https://apacheignite.readme.io Fixed. > On 14 дек. 2015 г., at 14:05, Denis Magda <dma...@gridgain.com> wrote: > > BTW, > > Could you tell us where did you find an UI element that has this link: > > https://ignite.apache

Re: Need to effect cache at time of changes made in database

2015-12-09 Thread Denis Magda
Kamesh, BTW, please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send an email to “ user-subscr...@ignite.apache.org” and follow simple instructions in the reply. -- View this message in context:

Re: Grid stopped with IgniteCheckedException: Failed to deserialize object with given class loader: sun.misc.Launcher$AppClassLoader

2015-12-16 Thread Denis Magda
Hi, I'm unable to download the logs provide by you. Get '404' error all the time. Please upload them to the other storage and in addition attach configs that are used by your servers. -- Denis On 12/15/2015 10:16 AM, sunyson wrote: Hi, I have download 1.5.0-b1 and make it happened again.

Re: How to get rid of the message( Received message without registered handler ) ?

2016-01-07 Thread Denis Magda
Hi, The message appears when there is no internal handler registered to process it. A potential reason I have in mind is that you can start/stop Ignite nodes during the time a continuous query is being used. Please provide me with a complete example that can be run locally so that I can

Re: Can build 10000+ Continuous Queries for one cache which has more than a hundred million data

2016-01-07 Thread Denis Magda
Hi, If all SQL query indexes ([1] and [2]) are properly configured then you shouldn't observe any significant performance degradation. [1] https://apacheignite.readme.io/docs/sql-queries#section-single-column-indexes [2] https://apacheignite.readme.io/docs/sql-queries#section-group-indexes --

Re: Distributed queue problem with peerClassLoading enabled

2016-01-07 Thread Denis Magda
Hi Mateusz, 1. It seems that distributed cache is still *not* available in PRIVATE/ISOLATED modes. Is this correct? Right, it hasn't been fixed yet. I've just followed up the related discussion on the dev list. Please follow it to see the most up-to-date information

Re: Is there limitation on Semaphores and Queues?

2016-01-07 Thread Denis Magda
Hi, Please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send an email to “ user-subscr...@ignite.apache.org” and follow simple instructions in the reply. There is no any limitation on the number of semaphores or queues in

Re: Is there a hook on cache entry expiry?

2015-12-30 Thread Denis Magda
Yes, it would work. Just give a try. -- Denis On Wednesday, December 30, 2015, kevin wrote: > Thanks Denis for pointing me to EVT_CACHE_OBJECT_EXPIRED. > > But let me expand, what I want is to have multiple entries expire in one > transaction. > > Example: >

Re: Off heap disc location

2016-01-09 Thread Denis Magda
Hi Vinay, Please see my answers inline On 1/9/2016 9:22 PM, vinshar wrote: How can i specify a off heap disc location for a cache? What is default? If you mean a swap location where data is evicted from RAM then you can override a default swapping location this way // Configure swap spi

Re: Cross Cache Affinity

2016-01-09 Thread Denis Magda
Hi Vinay, 1) No, it's not advisable to use the same cache for different types of objects. The example from the article had a mistake. Fixed the example in a way that every object of an unique type is stored in a specific cache. Thanks for noting this! 2) Since replicated cache stores a copy

Re: Utility to check size of entries in off-heap

2016-01-09 Thread Denis Magda
Hi Raghu, What commands did you execute to get cache statistics using Visor console (ignitevisorcmd.bat)? I've used 'cache -a' and get the same details for both on-heap and off-heap memory modes./ / /Is there a way I can check the size of entries in the off-heap region? / You can but under

Re: how to use jdbc

2016-01-09 Thread Denis Magda
Vinay, It's possible to query data from an Ignite cache using JDBC API [1]. That was a topic of the question. [1] https://apacheignite.readme.io/docs/jdbc-driver -- Denis On 1/9/2016 8:42 PM, vinshar wrote: What are you trying to do here by passing ignite configuration xml path in JDBC

Re: Is there a hook on cache entry expiry?

2015-12-30 Thread Denis Magda
Now I see what you're trying to achieve. When you're executing these lines of the code for (int i = 0; i < 100_000; i++) { cache2.put(i, i); each cache entry will have expiration time that can be calculated as ET = current_time + policy_expire_time. It's worth to mention that

Re: Error at cachequeryexample on withKeepBinary

2016-01-08 Thread Denis Magda
Hi, Please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send an email to “ user-subscr...@ignite.apache.org” and follow simple instructions in the reply. My guess is that you have a compilation error. Make sure that you're

Re: Issue with TcpDiscoveryJdbcIpFinder

2016-01-08 Thread Denis Magda
Hi, Please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send an email to “ user-subscr...@ignite.apache.org” and follow simple instructions in the reply. TcpDiscoveryJdbcIpFinder does check whether a table exists or not

Re: Is there limitation on Semaphores and Queues?

2016-01-08 Thread Denis Magda
Anatoly, Please properly subscribe to the user list (this way we will not have to manually approve your emails and you will get answers on your questions quicker). All you need to do is send an email to “ user-subscr...@ignite.apache.org” and follow simple instructions in the reply Since the

Re: How asynchronous cache is implemented

2016-01-08 Thread Denis Magda
Hi Antonio, Actually a cache related request goes this way: - first it gets to org.apache.ignite.internal.processors.cache.GridCacheIoManager; - after that it's transferred to org.apache.ignite.internal.managers.communication.GridIoManager which sends the request using one of

Re: Is there limitation on Semaphores and Queues?

2016-01-09 Thread Denis Magda
appened, then the object state in DBs would be inconsistent. > > That’s why I want to use Ignite semaphore > > > > > > > > *From:* Denis Magda [via Apache Ignite Users] [mailto:[hidden email] > <http:///user/SendEmail.jtp?type=node=2454=0>] > *Sent:*

Re: can i install ignite on windows server?

2015-12-28 Thread Denis Magda
Hi, We've received a notification from you when you posted the message above. So for now you have subscribed successfully. -- Denis -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/can-i-install-ignite-on-windows-server-tp2316p2326.html Sent from the Apache

Re: Connection to grid

2015-12-28 Thread Denis Magda
Hi Yury, There is no difference. As Valentin mentioned above you just need to provide Visor with a configuration file where TcpDiscoverySpi contains an IP finder with a list of address of the nodes from your grid. If you take a look at example-ignite.xml you'll see that Visor will try to find a

Re: Ideal number of partitions for a small cache

2015-12-22 Thread Denis Magda
Hi Noam, The main rule is that a number of partitions should be bigger than a number of the nodes in a cluster. Otherwise you definitely won't get uniform number of partitions' assignments across all the cluster nodes. In practice the rendezvous affinity function sometimes has ~10%

Re: Queries including sub-classes

2015-12-21 Thread Denis Magda
Hi, Presently in SQL queries you can't use a predecessor's name to retrieve data for all its subclasses stored in a cache. The reason is that for every type, registered with CacheConfiguration, Ignite creates a corresponding flat H2 type descriptor that doesn't store hierarchy information.

Re: Queries including sub-classes

2015-12-22 Thread Denis Magda
Hi, However please be careful with scan queries in a sense that they are doing full scans. So if your data set is significant then it can effect the performance. Regards, Denis -- View this message in context:

Re: Ignite and Spark Streaming Integration Using Java

2015-12-22 Thread Denis Magda
Hi Jennifer, You received the following message IP finder returned empty addresses list. Please check IP finder configuration and make sure multicast works on your network. Will retry every 2 secs. because the node that was being started by you was a client node. Client's node join process

Re: Behaviour on Partition when Node is down

2015-12-22 Thread Denis Magda
He Welly, By default number of backups is equal to 0. Change this default value using CacheConfiguration.setBackups(...) methods. After that everything should work fine in your scenario. Regards, Denis On 12/23/2015 10:22 AM, Welly Tambunan wrote: Hi All, I'm just trying a scenario in my

Re: Sorting behaviour on Time Series data in partitioned cache

2015-12-23 Thread Denis Magda
-4b35-b08a-1742c97865ef,*6*,6)] Entry [key=SeriesKey(274061d5-7b48-4b35-b08a-1742c97865ef,7), val=TimeSeries(274061d5-7b48-4b35-b08a-1742c97865ef,*7*,7)] On Wed, Dec 23, 2015 at 2:44 PM, Denis Magda <dma...@gridgain.com <mailto:dma...@gridgain.com>> wrote: Hi Welly, "chId"

Re: Two ignite instance without linking

2015-12-30 Thread Denis Magda
Hi, This is just an address of a specific multicast group. Every node that is a part of this multicast group will be able to see each other and won't be able to see the nodes that have different multicast group being set in their TcpDiscoveryMulticastIpFinder configuration. Regards, Denis --

Re: Is there a hook on cache entry expiry?

2015-12-30 Thread Denis Magda
Hi, When a cache entry gets expired Ignite fires EVT_CACHE_OBJECT_EXPIRED event. Just subscribe for this kind of event notifications if you want to know when this happens. This article [1] contains more info on how to work with events in Ignite. However, when a cache entry is expired it's

Re: Two ignite instance without linking

2015-12-30 Thread Denis Magda
You can use any multicast address that is available for you. Ignite doesn't have any limitations. -- Denis -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Two-ignite-instance-without-linking-tp2342p2352.html Sent from the Apache Ignite Users mailing list

Re: Ignite Shared Rdd

2015-12-30 Thread Denis Magda
Hi Kira, It can be any kind of applications that needs to have an RDD that must be shared among different Spark jobs. Such a shared RDD can preserve a state or data that can be reused by many Spark jobs in parallel or later. Shared RDD is a contribution from Ignite to Spark and not a

Re: Ignite Shared Rdd

2015-12-29 Thread Denis Magda
Hi, There is a specific documentation sections exists on Apache Ignite Readme.io site. Most probably you'll get the answers on all your questions after looking at the following articles https://apacheignite.readme.io/docs/shared-rdd

Re: when i excute compute.broadcast(),why run on only one node?

2015-11-26 Thread Denis Magda
Hi, Please make sure that all your three nodes already joined the same cluster at the time you're sending the broadcast closure. Check that on the sender side there is a line like this in the logs: Topology snapshot [ver=3, servers=3, clients=0, CPUs=8, heap=3.5GB] And please properly

Re: remove cache on high-speed

2015-11-25 Thread Denis Magda
Hi, I'm a bit confuse. You say that cache.size() evaluates to 0 but how do you find out that there are some entries left in the cache? Sorry, if I didn't get this from your latest responses. In any case I don't think continuous queries influences on what you're observing. To make things

Re: off heap memory

2015-11-25 Thread Denis Magda
Hi, You're correct saying that Ignite's off-heap cache memory mode uses Unsafe at the implementation layer. Right, there is no any de-fragmentation related logic in Ignite, this is delegated to an operating system that knows how to do this better. Allocated memory re-usage, what slab

Re: Unable to find ignite artifacts

2015-11-30 Thread Denis Magda
Hi Kobe, You should choose either http or ftp mirror from the combo box "Selected mirror" below. We will fix this issue on our side. Thanks for pointing out to this. -- Denis On 12/1/2015 2:35 AM, Kobe wrote: vkulichenko wrote Kobe wrote I also find that

Re: Continuous update Data Grid Cache

2015-12-01 Thread Denis Magda
operation? - Create a new cache and isolate it from being replicated with the old cache. - Populate data on new cache - Shutdown old cache and remove the new cache isolation. fsapei Am 30.11.2015 um 12:51 schrieb Denis Magda <dma...@gridgain.com <mailto:dma...@gridgain.com>>: Fsa

Re: Could not get any response from SQL Query

2015-12-01 Thread Denis Magda
reads. I setup a parallel request with 2500 requests in JMeter. When the data on the server is only 998 entries, JMeter performs the test without any problems. However, with a really big data (40491131 entries), I do not get any response anymore from Ignite. Could it be that I have to allo

Re: Using ignite configuration with JCache api

2015-11-18 Thread Denis Magda
Sridhar, Please check where Ignite home directory refers to in your case. Just executed the following code System.out.println(System.getProperty(IgniteSystemProperties.IGNITE_HOME)) Then create 'config' folder there and put default-config. xml in this folder. You can always change Ignite

Re: shared RDD jni mapping

2015-11-18 Thread Denis Magda
Hi Ben, Please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send an email to “user-subscr...@ignite.apache.org” and follow simple instructions in the reply. Actually I haven't heard that anyone from the community the

Re: IllegalArgumentException: Invalid URI for NameNode address (check fs.defaultFS): igfs://igfs@localhost is not of scheme 'hdfs'

2015-11-20 Thread Denis Magda
Hi Robert, So, no more issues so far with this and workarounds work fine for you, right? -- Denis On 11/19/2015 5:43 PM, RobertOfFairfax wrote: Hi Ivan, The hadoop wrapper example in IGNITE-483 with an updated HADOOP_CLASSPATH worked

Re: Ignite performance on multicore

2015-11-20 Thread Denis Magda
Hi Ambha, Please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send an email to “user-subscr...@ignite.apache.org” and follow simple instructions in the reply. What particular concurrent APIs do you mean? In general,

Re: off heap memory

2015-11-20 Thread Denis Magda
Hi Ambha, Please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send an email to “user-subscr...@ignite.apache.org” and follow simple instructions in the reply. In short, the 'off-heap' is just a part of the memory that

Re: Data Loading Performance Issue

2015-11-19 Thread Denis Magda
Hi Deha, These two pools related settings [1] from your configuration file explicitly reduce the overall performance of your system. By setting the values to '1' will lead to the situation when a bunch of logic will start working a single-threaded mode regardless of the numbers of CPUs

Re: Connection refused via JDBC

2016-01-11 Thread Denis Magda
Hi, Please subscribe to the user list (this way we will not have to manually approve your emails, it's really annoying). All you need to do is send an email to “ user-subscr...@ignite.apache.org” and follow simple instructions in the reply. >From what I see, JdbcConnectionPool is H2 database

Re: Ignite Events overhead

2016-01-12 Thread Denis Magda
Hi, Please see my answers inline On 1/12/2016 10:23 AM, pavlinсм wrote: Hello, I have two questions about events : 1) In the documentation one can read "/Since thousands of events per second are generated, it creates an additional load on the system./" What kind of load to expect with local

Re: Setting both offHeapMaxMemory and cacheStoreFactory

2016-01-13 Thread Denis Magda
Hi, Please see my answers inline On 1/13/2016 10:44 AM, Ambha wrote: I have a few doubts on off heap cache configuration 1. Is it possible to set both off-heap and cache store with write behind mode for a cache? The configuration looks like:

Re: Write Behind data safety guarantees ?

2016-01-10 Thread Denis Magda
Hi Erick, In the situation when a new cache entry arrives to the write-behind store and there is no more space to queue it up for later flushing the store will perform a flush of a single already queued entry from the Thread that is writing the newly arrived entry. It means that a

Re: How to retrieve data from Collocated Cache with Simple Key

2016-06-06 Thread Denis Magda
Hi Kamal, There is no need to use any workaround like ScanQueries or iterators. You just need to use a valid key to retrieve the data. The valid key in your example is new AffinityKey<>(key, affray). It means that every time you need to put or get a Person from the cache you need to use this

Re: Cluster Topology Failure Detection

2016-06-07 Thread Denis Magda
Hi, Please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send an email to ì user-subscr...@ignite.apache.orgî and follow simple instructions in the reply. In regards to your question, you can subscribe for

Re: Increase transaction throughput with nodes.

2016-06-07 Thread Denis Magda
Hi, Your understanding is correct. The overall throughput should grow if you scale horizontally. However in case of distributed transactions many factors can be a reason of why the performance doesn't grow significantly: - the same locks are held by multiple pessimistic transactions; -

Re: cluster coming down after data before loading complete data

2016-06-07 Thread Denis Magda
Hi, Please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send an email to ì user-subscr...@ignite.apache.orgî and follow simple instructions in the reply. How big is you dataset? What is the reason why you store a HashMap

Re: Unable to load config from absolute path.

2016-06-07 Thread Denis Magda
Hi, Please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send an email to ì user-subscr...@ignite.apache.orgî and follow simple instructions in the reply. Please provide the full stack trace that should contain the cause of

Re: Poor performance select query with jdbc

2016-06-07 Thread Denis Magda
Hi, Please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send an email to ì user-subscr...@ignite.apache.orgî and follow simple instructions in the reply. In regards to your question try to increase

Re: whether IgniteHadoopIgfsSecondaryFileSystem will cache HDFS filein IGFS?

2016-06-07 Thread Denis Magda
Hi, What numbers do you get? What Ignite version are you on? In fact IGFS should give you performance boost but make sure that you’re using Ignite 1.6.0 that has many performance related optimizations in this area. — Denis > On Jun 3, 2016, at 9:56 AM, Jason <410353...@qq.com> wrote: > > It

Re: Increase transaction throughput with nodes.

2016-06-08 Thread Denis Magda
Give it a try to see the difference. — Denis > On Jun 8, 2016, at 9:50 AM, amitpa wrote: > > Should we change it to a value higher than 500 , if cpu limit is not present? > > > > -- > View this message in context: >

Fwd: ignite cache get performance issue when Key, Value not exist

2016-06-08 Thread Denis Magda
Igniters, This is not the first time I hear about from the community side about the performance issue Kevin is talking below. In short if a key is not located in a cache then we will go to an underlying storage. This process will be repeated all the time for the same key and this leads to

Re: Increase transaction throughput with nodes.

2016-06-07 Thread Denis Magda
Per cache. — Denis > On Jun 8, 2016, at 7:42 AM, amitpa wrote: > > Danis, > > CacheConfiguration.setMaxConcurrentAsyncOperations :- Is it set per cache or > in Ignite-Config on Node startup? > > > > -- > View this message in context: >

Re: ignite cache get performance issue when Key, Value not exist

2016-06-07 Thread Denis Magda
Hi Kevin, This happens because such information is not “cached” in the internals meaning that every time the database will be queried to see whether it has such a key or not. If you disable the database the performance should be good. In any case how critical is this for you? Is it some basic

Re: How to retrieve data from Collocated Cache with Simple Key

2016-06-08 Thread Denis Magda
Hi, Please see below > On Jun 8, 2016, at 2:36 PM, Kamal C wrote: > > In `put` operation, we have full object to insert so construction of > PersonKey / > AffinityKey is not a problem. But, during `get` operation, we may have only > the simple key to retrieve data. >

Re: CachePartialUpdateCheckedException:Failed to update keys (retry update if possible)

2016-06-07 Thread Denis Magda
Hi, Please properly subscribe to the user list (this way we will not have to manually approve your emails). All you need to do is send an email to ì user-subscr...@ignite.apache.orgî and follow simple instructions in the reply. In regards to your question I would suggest you switching to

Re: Is it possible to disable TcpRestProtocol?

2016-06-07 Thread Denis Magda
Hi Dave, The port is used to connect to a cluster using REST based protocol implementation. https://apacheignite.readme.io/docs/rest-api It’s used by Visor CMD utility https://apacheignite.readme.io/docs/command-line-interface If you don’t expect to use Visor or this feature in general you

Re: How to connect/monitor ignite server through jmx client

2016-06-06 Thread Denis Magda
Got you, if you start the node this way (programmatically) then IGNITE_JMX_PORT won’t work regardless of the operating system kind. You need to pass the following system parameters to your Java process (that calls Ignition.start) -Dcom.sun.management.jmxremote

Re: How to connect/monitor ignite server through jmx client

2016-06-06 Thread Denis Magda
How do you set this variable on the windows machine? What does “echo %IGNITE_JMX_PORT%" return? If you set in the windows registry then don’t forget to restart your command line terminal. — Denis > On Jun 6, 2016, at 3:09 PM, pragmaticbigdata wrote: > > Hi Denis, > >

Re: How to connect/monitor ignite server through jmx client

2016-06-06 Thread Denis Magda
Start the node with “-v” flag like this “ignite.bat -v" and share the logs. — Denis > On Jun 6, 2016, at 3:18 PM, pragmaticbigdata wrote: > > echo %IGNITE_JMX_PORT% gives the port that I have set. I haven't set it > through the registry. I have set it from the UI (Advanced

Re: Ignite for Spark on YARN Deployment

2016-06-07 Thread Denis Magda
Hi, I’m not an expert in this area however have you tried to specify a Spark master like the following documentation says? https://apacheignite-fs.readme.io/docs/testing-integration-with-spark-shell#working-with-spark-shell If you did try please share the full logs, someone from the community

Re: Maven conflicts within ignite-core from duplicated classes

2016-06-13 Thread Denis Magda
Hi Pete, CC-ing Ignite dev list to the thread as well. Igniters, up to today is there any reason why we need to include sources of Nullable JetBrain’s annotation in Ignite sources? As I see we can rather import that latest version from the maven repository

  1   2   3   4   5   6   7   8   9   10   >