How is the book "High Performance in-memory computing with Apache Ignite"

2016-11-24 Thread /Bob
The book is in the web site: https://leanpub.com/ignite Bob --- Confidentiality Notice: The information contained in this e-mail and any accompanying attachment(s) is intended only for the use

java.lang.IllegalStateException: Failed to create data streamer (grid is stopping).

2016-10-30 Thread /Bob
Hi I am using Ignite 1.6. I meet the exception as the mail title when I call cache.loadAll(keys, true, null); And this Exception is not logged. I found this through debugging. Actually, the ignite cluster is running. Can anyone tell what is the possible reason? Than

Re: Re: Why doesn't the index be used in my test?

2016-10-25 Thread /Bob
it doesn't help, provide your query configuration. [1]: https://apacheignite.readme.io/docs/sql-queries On Mon, Oct 24, 2016 at 10:47 AM, 胡永亮/Bob wrote: Hi everyone, I have a model Kc21, akc273 is its one String column . I create the index in this column, as the following: @QuerySqlField(index

Why doesn't the index be used in my test?

2016-10-24 Thread /Bob
Hi everyone, I have a model Kc21, akc273 is its one String column . I create the index in this column, as the following: @QuerySqlField(index = true) private String akc273; Then I load data into cache from oracle, total 47535542 rows. I execute the sql query to get the e

One question about Partition-aware data loading

2016-10-21 Thread /Bob
Hi everyone, In official document, there are some code about Partition-aware data loading. private void loadPartition(Connection conn, int part, IgniteBiInClosure clo) { try (PreparedStatement st = conn.prepareStatement("select * from PERSONS where partId=?")) { st.setInt(1,

Re: Re: Some problems in test case which comparing sql query performance between Ignite and Oracle

2016-10-20 Thread /Bob
Hi Warm-hearted person, Thanks for your help. According to your advice, I will query some field not using select *. I will add the index in the cache. To Vladislav Pyatkov, In previous mail, you said "you are always can copy data to another cache (with index) and drop this",

Some problems in test case which comparing sql query performance between Ignite and Oracle

2016-10-20 Thread /Bob
Hi, everyone My test environment: Ignite cluster has 8 nodes, every node has 8 cores CPU and 30G memory. Their network has 1000M speed. Oracle is deployed in the machine which has 32G memory and 8 cores CPU. My db table has 47535542 rows with 99 columns. When no index, the cost

Re: Re: Can't increase the speed of loadCache() when increasing more Ignite node

2016-10-18 Thread /Bob
will iterate WHOLE data set, but will take 33% of keys. There is no general solution to speedup load. On Tue, Oct 18, 2016 at 1:34 PM, 胡永亮/Bob wrote: Hi, I load data into Ignite from oracle with loadCache(). I load 100w data, when Ignite cluster has one node, its cost time is 2m27s.

Can't increase the speed of loadCache() when increasing more Ignite node

2016-10-17 Thread /Bob
Hi, I load data into Ignite from oracle with loadCache(). I load 100w data, when Ignite cluster has one node, its cost time is 2m27s. Two nodes, its cost time is 2m18s, three 2m15s, four 2m11s. I have tested reading the 100w data through jdbc, its cost time is 40s. Why don'

where to get the document about Ignite architecture or technical advantage?

2016-10-13 Thread /Bob
Hi, everyone I only find some document aboute Ignite function, but I want to know how to implement those functions. Where can I get the architecture document? So, I have some deeper problem to be explained. For example, 1, The sql query of Ignite is implemented with MapRed

Re: Re: A very slow code of using entryprocessor, why?

2016-09-25 Thread /Bob
Hi, Val According to your suggestion, I have a deeper understanding about this. I will have a try. Val, Thank you very much. Bob From: vkulichenko Date: 2016-09-24 06:06 To: user@ignite.apache.org Subject: Re: A very slow code of using entryprocessor, why? Hi Bob, Each invoke

A very slow code of using entryprocessor, why?

2016-09-23 Thread /Bob
hi, everyone The code and related log are the following content, how can I do to increase the performance? Thank you very much. Code: IgniteCache>> mapMatchingData = IgniteManager.getInstance().getMapMatchingData(); Iterator>>> it1 = mapMatchingData.iterator(); while(it1.hasNext(

How to get all keys of cache most quickly?

2016-09-23 Thread /Bob
Hi, everyone, About this question, I search the mail list and Ignite java doc, but no suitable answer was found. My use case is, I have a cache whose structure is IgniteCache>>. I want loop all entries to remove some entries in Map value. So, first, I want to get all keys, and

Re: Re: Increase Ignite instances can't increase the speed of compute

2016-09-22 Thread /Bob
Hi, Val Thank you very much, I think this is very helpful for me. I will change my compute code, and have a try. Bob From: vkulichenko Date: 2016-09-23 07:00 To: user@ignite.apache.org Subject: Re: Re: Increase Ignite instances can't increase the speed of compute Hi Bob, Most likel

Re: Re: Increase Ignite instances can't increase the speed of compute

2016-09-21 Thread /Bob
shortcomings in your code, but me was not clear which size of data moved between nodes or are data collect? Can you create working example? So I was able to reproduce the problem. On Tue, Sep 13, 2016 at 12:06 PM, 胡永亮/Bob wrote: Only 118 jobs for this test. Bob From: Taras Ledkov D

Re: Re: Increase Ignite instances can't increase the speed of compute

2016-09-13 Thread /Bob
Only 118 jobs for this test. Bob From: Taras Ledkov Date: 2016-09-13 14:52 To: user@ignite.apache.org Subject: Re: Re: Increase Ignite instances can't increase the speed of compute Hi, How many MatchingJobs do you submit? On Tue, Sep 13, 2016 at 12:29 PM, 胡永亮/Bob wrote:

Re: Re: Increase Ignite instances can't increase the speed of compute

2016-09-12 Thread /Bob
slav Pyatkov Date: 2016-09-12 18:37 To: user@ignite.apache.org Subject: Re: Increase Ignite instances can't increase the speed of compute Hello, I don't understand, what do you try to measure, without code. Size of calculation task, size of data moved into network have importance. Could yo

Increase Ignite instances can't increase the speed of compute

2016-09-12 Thread /Bob
Hi, everyone: I am using Ignite for computing and cache. I use the same input data and the same compute logic. When my ignite cluster's node is 2 in 2 machines, the total cost time is 38s. But, when I increase the Ignite cluster nodes to 3 in 3 machines, the cost time is 32s/51

Re: Re: null exception about EntryProcessor

2016-08-25 Thread /Bob
so it doesn't always lead to exception, but you need to do it for prevent issues of serialization. Is static EntryProcessor allow to avoid NPE exception in your case? On Thu, Aug 25, 2016 at 3:56 AM, 胡永亮/Bob wrote: hi Alexey, This is example from official website. No static EntryProcessor. I

Re: Re: null exception about EntryProcessor

2016-08-24 Thread /Bob
You need to make your EntryProcessor a static class, otherwise it captures a reference to your enclosing class which causes the serialization exception. 2016-08-24 17:54 GMT+03:00 Vladislav Pyatkov : Hello, Could you please provide reproduced example? On Wed, Aug 24, 2016 at 11:04 AM, 胡永亮/B

null exception about EntryProcessor

2016-08-24 Thread /Bob
hi, everyone: When I use EntryProcessor to update value in remote node, the statement entry.getValue() throwed null exception. The log detail is in the attachement file log.txt. I don't know why. I first do a check with the statement cache.containsKey(key), if it is true, then

Re: Re: SQL join query return different result under the same data when having different ignite instance.

2016-07-27 Thread /Bob
Val, I am very happy to unstand this. Bob From: vkulichenko Date: 2016-07-28 12:42 To: user@ignite.apache.org Subject: Re: Re: SQL join query return different result under the same data when having different ignite instance. Bob, With the new schema a class can belong only to on

Re: Re: SQL join query return different result under the same data when having different ignite instance.

2016-07-27 Thread /Bob
Hi Val, Yes, I do the change as you suggest. Now, the tables is the following: School: id name address 1 xxx aaa Class: id name number schoolID 1 yyy bbb 1 Student: id name sex schoolID classID 1 zzz male 1 1 And the cache keys ar

Re: Re: SQL join query return different result under the same data when having different ignite instance.

2016-07-26 Thread /Bob
Hi Val, My query is complex, I use another example to descripte my scenario. There are three objects: School, Class, Student. School: id name address 1 xxx aaa Class: id name number 1 yyy bbb Student: id name sex schoolID classID 1 zzz male 1 1 Now

Re: Re: SQL join query return different result under the same data when having different ignite instance.

2016-07-21 Thread /Bob
; + " AND Kc21.akc190 = Kc24.akc190" + " AND Kc24.akb020 = Kc60.akb020" + " AND Kc24.akc190 = Kc60.akc190" + " AND Kc24.aae072 = Kc60.aae072" + " AND Kc24.bka135 = Kc60.bka135" + " AND COALESCE (Kc24.bkc380, '0') = '0'" + &q

Re: Re: SQL join query return different result under the same data when having different ignite instance.

2016-07-21 Thread /Bob
Hi, Alexey: First, thank you. But, I don't know how to config the affinity for my sql, because it is too complex. My sql is: "select * FROm Kc21, \"Kc24Cache\".Kc24" + ", \"Ka06Cache\".Ka06, \"Kc60Cache\".Kc60 " + " WHERE Kc21.akb020 = Kc24.akb020" + " AND Kc21.akc190 = Kc24.akc

SQL join query return different result under the same data when having different ignite instance.

2016-07-20 Thread /Bob
hi, everyone: I am using the ignite 1.6. I have the sql query: String querySql = "select count(*) FROm Kc21, \"Kc24Cache\".Kc24" + ", \"Ka06Cache\".Ka06, \"Kc60Cache\".Kc60 " + " WHERE kc21.akb020 = kc24.akb020" + " AND kc21.akc190 = kc24.akc190" + " AND kc24.akb020 = kc60.akb020" +

回复: Ignite used memory 7 times greater than imported data

2016-07-13 Thread /Bob
emory? Ignite consume too much memory!!! Thanks. Bob 发件人: 胡永亮/Bob 发送时间: 2016-07-12 17:22 收件人: user@ignite.apache.org 主题: Ignite used memory 7 times greater than imported data Hi, everyone I meet a problem: Ignite used 220G+ memory, but the imported data is only 31G. Why? Basic info: I

Ignite used memory 7 times greater than imported data

2016-07-12 Thread /Bob
Hi, everyone I meet a problem: Ignite used 220G+ memory, but the imported data is only 31G. Why? Basic info: I used Ignite 1.6, and deployed ignite cluster using 2 machine whose memory is 128G. I run 3 ignite instance in every machine. I am using JDK8. I has 31G data in csv fil

Re: Re: argument type mismatch of oracle TIMESTAMP field when call loadCache

2016-06-30 Thread /Bob
The related code was not changed for fixing this bug. I want to know, how can I get the code patch? thanks. 胡永亮 Bob From: Vasiliy Sisko Date: 2016-06-29 15:37 To: user@ignite.apache.org Subject: Re: Re: argument type mismatch of oracle TIMESTAMP field when call loadCache

Re: Re: argument type mismatch of oracle TIMESTAMP field when call loadCache

2016-06-28 Thread /Bob
sorry, the infomation is not in detail. My ignite's version is new release version: 1.6. 胡永亮 Bob From: Vasiliy Sisko Date: 2016-06-28 19:18 To: user@ignite.apache.org Subject: Re: Re: argument type mismatch of oracle TIMESTAMP field when call loadCache Hello Bob. What version of I