Re: How to access Apache Ignite service grid services from a J2ee application server

2017-07-17 Thread Alexander Fedotov
Could you describe or share the code where and how you create Ignite client? Kind regards, Alex 16 июля 2017 г. 11:32 AM пользователь "krutipatel" написал: When I try to access using service-proxy through a client-mode ignite from within the J2ee app. The app is stuck to receive the data from t

Issue with Ignite + Zeppelin

2017-07-17 Thread Megha Mittal
Hi, I am trying to configure Ignite interpreter on Zeppelin. I have 1 server running on my local. Zeppelin is also running on my local. Zeppelin interpreter configurations are : ignite.addresses127.0.0.1:47500..47509 ignite.clientMode true ignite.config.url ignite.jdbc.url jd

Re: How to access Apache Ignite service grid services from a J2ee application server

2017-07-17 Thread Alexander Fedotov
Make sure that you are creating an Ignite client within a singleton bean. Kind regards, Alex. On Mon, Jul 17, 2017 at 11:32 AM, Alexander Fedotov < alexander.fedot...@gmail.com> wrote: > Could you describe or share the code where and how you create Ignite > client? > > Kind regards, > Alex > > 1

Re: Two ignite instances on a vm

2017-07-17 Thread Andrey Mashenkov
Hi Anil, Try to set discovery port ranges in IpFinder configuration, I see only addresses there. On Sun, Jul 16, 2017 at 10:17 AM, Anil wrote: > HI Alex, > > I am using ignite 1.9 with vertx 3.4.1. ignite instance name is grid name > in 1.9. Am i wrong ? vertx assigns the unique grid name and n

Re: sql query in case of cluster group

2017-07-17 Thread neerajbhatt
Hi Andrew It seems to be an order by issue. We have created a test project in github https://github.com/neerajbhatt/testIgnite If we use PutItems to put some records in a partitioned cache(TESTCACHE) args[0]=number of records, and then Get the items by GetItemsWithClusterGroup args[0] = query ty

Re: sql query in case of cluster group

2017-07-17 Thread Andrey Mashenkov
1. LIMIT make no sense without ORDER for non-local queries and when sqlQueryParallelizm > 1. As in that case, data from different index segments will be merged out of order and you can get different results with same query from run to run . 2. You use ClusterGroup to make your jobs to be run on ce

New blog post: Implementing Ignite.NET Plugin, interacting with Java

2017-07-17 Thread Pavel Tupitsyn
Subj: https://ptupitsyn.github.io/Ignite-Plugin/ Pavel

Re: how to use Apache ignite as backend layer for computation/aggregation of a reporting webapplication

2017-07-17 Thread ezhuravlev
Hi, answered you on SO: https://stackoverflow.com/questions/45136355/how-to-use-apache-ignite-as-backend-layer-for-computation-aggregation-of-a-repor/45141951#45141951 lets continue there if you have any questions Evgenii -- View this message in context: http://apache-ignite-users.70518.x6.n

Re: sql query in case of cluster group

2017-07-17 Thread neerajbhatt
We are using cluster groups to run query on each nodes of the cluster so that we can set the timeout on each query. We are running local queries and in TestIgniteCallable we have given List> res = cache.query(qry.setArgs().setLocal(true)).getAll(); What are we missing ? -- View this message in

Re: sql query in case of cluster group

2017-07-17 Thread Andrey Mashenkov
You can use SqlFieldsQuery.setTimeout() for this. Would you please check if it is workable without queryParalellism? Looks weird, I need a time to make a test and check if local queries with queryParalellism>1 is broken. On Mon, Jul 17, 2017 at 1:44 PM, neerajbhatt wrote: > We are using cluste

Re: sql query in case of cluster group

2017-07-17 Thread neerajbhatt
Hi Andrey, we are not using query timeout, because we want to get partial results, in case 1 node is slow, but other nodes are faster. So, we are using cluster groups. Yes, just checked. If we don't use queryParallelism, then the query works well.. :) Kindly create a jira if you have same obser

Re: 答复: how to set the interval time between tests while running yardstick-ignite

2017-07-17 Thread agura
There are no any time interval between tests. It's test duration. You can change it in configuration file using `d` property. E.g. for 5 minutes you should use: # Duration. d=300 -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/how-to-set-the-interval-time-bet

Exception while using Transactions and Write Through

2017-07-17 Thread Narayana Rengaswamy
Hi, I'm getting the below exception when trying to update cache using TransactionScope API. If I access only one cache, the error does not happen. The transactionscope.Complete() call works fine always, but the dispose call is what throws exception. The code first selects data from multiple cac

Re: Need some clarification about cache statistics and off-heap memory.

2017-07-17 Thread mcherkasov
Hi, Please first of all properly subscribe to the mailing list so that the community can receive email notifications for your messages. To subscribe, send empty email to user-subscr...@ignite.apache.org and follow simple instructions in the reply. by default Ignite 2.+ stores all data in off heap

Re: 回复:Weird index out bound Exception

2017-07-17 Thread agura
Your client node could get cache by name. There is no any need to init cache configuration if cache already created on servers. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Weird-index-out-bound-Exception-tp14905p15004.html Sent from the Apache Ignite Users ma

Re: Re:Weird index out bound Exception

2017-07-17 Thread Andrey Gura
> Also what's the different between the #getOrCreateCache and #cache. #getOrCreateCache() return cache if it's already created or creates and then return newly created cache. #cache() just returns cache by name or null if cache doesn't exist. > So if a pure client query side which API should pr

Re: Heap Memory Allocation

2017-07-17 Thread Mikhail Cherkasov
Hi Gracelin, Ignite uses Runtime.getRuntime().maxMemory() to show heap size. For -Xmx20g JVM returns 18GB. So it depends on the -Xmx that you pass to JVM, but as you can notice it doesn't absolutlly equal to what return Runtime.getRuntime().maxMemory(). Thanks, Mikhail. On Fri, Jul 14, 2017 at 1

database table polling

2017-07-17 Thread luqmanahmad
Hi, We have a legacy system, 15 years old at-least, which we are working on and trying to bring everything inside the grid - but in the meanwhile we have to support our existing system as well. In the legacy system we have a database polling mechanism ( please don't roll your eyes :D ) which is con

Ignite2.0 Off Heap Storage

2017-07-17 Thread Ajay
Hi All, I loaded the data in off heap memory Ignite2.0, but when run visor cmd it was showing data in heap. I attached configuration xml, please let me know whether it was configuration problem or visor cmd issue. ignite_server_config.xml

Re: Ignite2.0 Off Heap Storage

2017-07-17 Thread Mikhail Cherkasov
Hi, By default Ignite 2.+ stores all data in off heap, visor cmd shows wrong value, there's a bug for this: https://issues.apache.org/jira/browse/IGNITE-5461 Thanks, Mikhail. On Mon, Jul 17, 2017 at 6:24 PM, Ajay wrote: > Hi All, > > I loaded the data in off heap memory Ignite2.0, but when ru

Re: database table polling

2017-07-17 Thread Andrey Mashenkov
Hi Luqman, Please take a look at continuous queries.[1] [1] https://apacheignite.readme.io/docs/continuous-queries On Mon, Jul 17, 2017 at 5:45 PM, luqmanahmad wrote: > Hi, We have a legacy system, 15 years old at-least, which we are working > on and trying to bring everything inside the grid

Re: Inserting Data From Spark to Ignite

2017-07-17 Thread agura
Hi, Could you please share your cache configuration and full error stack trace? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Inserting-Data-From-Spark-to-Ignite-tp14937p15011.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Ignite REST

2017-07-17 Thread Mikhail Cherkasov
Hi, I've just checked it and it works fine for me. Are you sure that there're no errors or warnings in ignite log? May be there's other process that is bound to 8080 port? Thanks, Mikhail. On Sun, Jul 16, 2017 at 1:51 AM, waterg wrote: > According to the document, I copied libs\optional\ignit

Re: Exception while using Transactions and Write Through

2017-07-17 Thread vkulichenko
Hi Narayana, Can you show the code that is working and that code that is not working? Also note that SQL queries are currently not enlisted in transactions anyway, so most likely you're not having semantics that you expect. Transactional support for SQL is expected sometime this year. -Val --

Re: Issue with Ignite + Zeppelin

2017-07-17 Thread vkulichenko
Hi, Can you show the server node log? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Issue-with-Ignite-Zeppelin-tp14990p15014.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Compute Grid Questions

2017-07-17 Thread vkulichenko
Hi Matt, 1. Each task or closure execution creates a session that has an ID. You can cast returned IgniteFuture to ComputeTaskFuture (unfortunately there is no other way now) and then use getTaskSession() method to get the session description. However, this information is available only on the nod

Re: How does CacheStore persistence actually work?

2017-07-17 Thread vkulichenko
1. I'm not sure this is correct. It's actually assumed that CacheStore is shared across nodes, i.e. it's a single entry point for persisting data. Underlying store itself can be distributed or not, but this must be transparent to Ignite. If each node writes to its own local storage, it all gets muc

Re: sql query in case of cluster group

2017-07-17 Thread Andrey Mashenkov
Hi Neeraj, Looks like queryParallelizm has buggy in ignite-2.0 that already fixed in master. Fix will be available in 2.1 version that it coming. Seems, it should be released in few days. On Mon, Jul 17, 2017 at 3:32 PM, neerajbhatt wrote: > Hi Andrey, > > we are not using query timeout, becau

Re: Two ignite instances on a vm

2017-07-17 Thread vkulichenko
Setting port ranges should help: X.X.X.1:47500..47509 X.X.X.2:47500..47509 -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Two-ignite-instances-on-a-vm-tp14965p15018.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Implementing Read through with sql server

2017-07-17 Thread vkulichenko
In 2.1 Ignite will have a persistence store that will allow to execute queries without preloading the data. But this will be an internal storage implementation, read-through for queries is impossible with arbitrary CacheStore implementation. -Val -- View this message in context: http://apache-

Re: Network Segmentation

2017-07-17 Thread vkulichenko
Yitzhak, Ignite doesn't allow reconnection of server nodes after segmentation. In general case this causes data inconsistency, so it was a design decision to make sure segmented nodes are fully restarted. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Net

RE: Heap Memory Limit Set

2017-07-17 Thread vkulichenko
Hi Priya, I would encourage you to learn the basics about how Java heap memory works. Basically, if you have different Xms and Xmx, JVM will start with lower bound, and then will allocate memory as needed until upper bound is reached. Log shows the amount of currently allocated memory. -Val --

Re: Async Service proxy

2017-07-17 Thread vkulichenko
I think creating your own pool on client side is the easiest way to support you case. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Async-Service-proxy-tp14478p15022.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: query performance degrade when adding a filter criteria (order by)

2017-07-17 Thread vkulichenko
Hi, Did you check execution plans? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/query-performance-degrade-when-adding-a-filter-criteria-order-by-tp14624p15023.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Data eviction to disk

2017-07-17 Thread vkulichenko
Check this: https://cwiki.apache.org/confluence/display/IGNITE/Persistent+Store+Overview -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Data-eviction-to-disk-tp14535p15024.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Ignite Information

2017-07-17 Thread vkulichenko
I can't reproduce this behavior. Can you create a small project that I can run on my side and investigate? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-Information-tp14330p15025.html Sent from the Apache Ignite Users mailing list archive at Nabble

Re: Can java code look up cache in server without Ignition.start(cfg)

2017-07-17 Thread vkulichenko
Saji, Ignite node in this case is embedded into the application. So it's up to this application to control the lifecycle. To stop an embedded node just call Ignition.stop(). -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Can-java-code-look-up-cache-in-ser

Re: database table polling

2017-07-17 Thread vkulichenko
Hi Luqman, What exactly do you mean by "new rows"? Is the database updated directly and you then need to refresh cache with these updates? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/database-table-polling-tp15006p15027.html Sent from the Apache Ignite

Re: Ignite 2.0 vs Ignite 1.7 (or later)

2017-07-17 Thread vkulichenko
You showed hot methods, not memory consumption... Do you have a project that you can share with us? This way I will be able to run on my side and investigate. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-2-0-vs-Ignite-1-7-or-later-tp14401p15028.ht

Re: database table polling

2017-07-17 Thread Jörn Franke
Which database? Some databases can notify an application id they are updated. You could read these updates with a Java application and insert them in the ignite cache. > On 17. Jul 2017, at 16:45, luqmanahmad wrote: > > Hi, We have a legacy system, 15 years old at-least, which we are working o

Re: SqlQuery for hibernate entities defined in *.hbm.xml

2017-07-17 Thread vkulichenko
Correct, you can use either annotations or query entities to configure SQL model for Ignite. More information here: https://apacheignite.readme.io/docs/indexes There is no way to use Hibernate configurations directly unless Ignite is used as L2 cache for Hibernate: https://apacheignite-mix.readme.

Re: database table polling

2017-07-17 Thread luqmanahmad
Hi Val, In our legacy system database polling is achieved through a separate table, let say P, in case employee is updated then a new row gets added to P table with the primary key of the employee which is updated and then a background process keeps polling that table for the update. In new syste

Re: Cache refresh because of hibernate versioning mechanism.

2017-07-17 Thread vkulichenko
Hi Czeslaw, Does myEntity object that is returned from DAO have old or new version value? Generally, your approach can work, but this looks like a serious performance overhead. Can you clarify, how exactly this versioning is used? Do you actually need it after switching to Ignite? -Val -- Vie

Re: Cache refresh because of hibernate versioning mechanism.

2017-07-17 Thread vkulichenko
One more point. You don't have to and should not pass IgniteCache as a parameter. Instead, you can inject Ignite into transient field in the CacheStore implementation and then use it to acquire cache: @IgniteInstanceResource private transient Ignite ignite; -Val -- View this message in context

Re: database table polling

2017-07-17 Thread Luqman Ahmad
Jorn, its oracle but we are migrating to postgres for newer system as the license is too expensive. But for now we need the solution for Oracle. I althought thought of deploying java classes into oracle instance but the end user are not comfortable with its already crowded. On 17 Jul 2017 7:23 pm

Re: database table polling

2017-07-17 Thread vkulichenko
Luqman, Got it. This is not available out of the box. But I think you can just create a cluster singleton service that will periodically call IgniteCache#loadCache to poll the data. Will this work? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/database-t

Re: database table polling

2017-07-17 Thread luqmanahmad
Val, This might work and adding continuous queries on top, it will fly. So silly I am using loadCache() every where in the new development but couldn't think of it for this one. Luqman On 17 Jul 2017 23:18, "vkulichenko [via Apache Ignite Users]" < ml+s70518n15037...@n6.nabble.com> wrote: Luqma

Re: New blog post: Implementing Ignite.NET Plugin, interacting with Java

2017-07-17 Thread Denis Magda
Pavel, the blog post is well deserved to be mentioned on this documentation page! https://apacheignite-net.readme.io/docs/plugins Please add it using a “callout” block of readme. — Denis > On Jul 17, 2017, at 3:31 AM, Pavel Tupitsyn wrote: >

Re: Data eviction to disk

2017-07-17 Thread Denis Magda
That’s a more high-level documentation that is to be released soon but you can already gain from it: https://apacheignite.readme.io/v2.1/docs/distributed-persistent-store — Denis > On Jul 17, 2017, at 11:13 AM, vkulichenko > wrote: > > Check this: > https://cwiki.apache.org/confluence/display

Re: Re:Weird index out bound Exception

2017-07-17 Thread aa...@tophold.com
Thanks! aa...@tophold.com 发件人: Andrey Gura 发送时间: 2017-07-17 21:50 收件人: user 主题: Re: Re:Weird index out bound Exception > Also what's the different between the #getOrCreateCache and #cache. #getOrCreateCache() return cache if it's already created or creates and then return newly created cach

Re: Compute Grid Questions

2017-07-17 Thread Matt
Hi Val, I tried doing *future.cancel()* and *compute().undeployTask("foo")*, check [1]. Are they equivalent in this case? *Thread.interrupted()* is always false, so I'm guessing that's not the correct flag I should be checking. [1] https://gist.github.com/anonymous/0a8759e70eddab470f09dcb92644f3

Re: New blog post: Implementing Ignite.NET Plugin, interacting with Java

2017-07-17 Thread Pavel Tupitsyn
Good point, done. On Tue, Jul 18, 2017 at 2:35 AM, Denis Magda wrote: > Pavel, the blog post is well deserved to be mentioned on this > documentation page! > https://apacheignite-net.readme.io/docs/plugins readme.io/docs/plugins> > > Please add it using a “callout” b