RE: Slow Group-By

2018-02-26 Thread Williams, Michael
Not sure how to check the GC log, but here's a minimal complete example using two java classes: Try these two queries. SELECT COUNT(DISTINCT((idnumber,value))) FROM athing SELECT COUNT (*) FROM (SELECT COUNT(*) FROM athing GROUP BY idnumber,value) Both queries do the same thing, you'll find

RE: Slow Group-By

2018-02-26 Thread Williams, Michael
Unfortunately, at this stage in dev, I'm only doing runs on one machine, and though I am using partitioned data to do query parallelism, it seems I lose that in the GROUP BY. Does GROUP_BY distribute at all? Might a spark layer on top give a better distribution path? Mike

RE: Slow Group-By

2018-02-26 Thread Williams, Michael
Oh, also, during the difference in time, only 1-2 cores seem to be involved. Mike From: Williams, Michael Sent: Monday, February 26, 2018 9:40 AM To: user@ignite.apache.org Subject: Slow Group-By All, Any advice on speeding up group-by? I'm getting great performance before the group-by clause

Slow Group-By

2018-02-26 Thread Williams, Michael
All, Any advice on speeding up group-by? I'm getting great performance before the group-by clause (on a fairly decent size data set) , but adding it slows things down horribly. Without the group-by clause, the query takes about a minute, and all cores are fully in use. With the group-by cores,

RE: Affinity Key Annotation

2018-02-16 Thread Williams, Michael
Ah, thanks! From: Alexey Kukushkin [mailto:kukushkinale...@gmail.com] Sent: Friday, February 16, 2018 5:40 AM To: user@ignite.apache.org Subject: Re: Affinity Key Annotation Michael, data colocation work like this: * Ignite caches have partitions assignments so that primary partitions with

RE: Affinity Key Annotation

2018-02-15 Thread Williams, Michael
Imagine, for example, I have four keys: Public class ThingOneKey { @QuerySqlField @AffinityKeyMapped int recordNo; ... } Public class ThingTwoKey { @QuerySqlField @AffinityKeyMapped int recordNo; @QuerySqlField Date

Affinity Key Annotation

2018-02-15 Thread Williams, Michael
Assume I have 4 integers tagged with @AffinityKeyMapped in different data structures. How does Ignite determine which correspond to affinity pairs? EG, if I wanted two pairs that have a mutual affinity, how would ignite know which to pair, or would all be paired together? Thanks, Mike

QuerySqlFunction

2018-02-14 Thread Williams, Michael
What changes do I need to do to make ZeroDeploy work with QuerySqlFunction definitions? I'm following the example and adding the class as follows, but even with peer class loading enabled, I get a gnarly error. Can clients marshal to servers? Any advice? import

RE: Dates before epoch - java.sql.Date

2018-02-13 Thread Williams, Michael
Yep, all set. Sorry. Getting better at this, honestly. -Original Message- From: vkulichenko [mailto:valentin.kuliche...@gmail.com] Sent: Tuesday, February 13, 2018 6:07 PM To: user@ignite.apache.org Subject: Re: Dates before epoch - java.sql.Date Mike, Looks like you already have a

Dates before epoch - java.sql.Date

2018-02-13 Thread Williams, Michael
If I need to store dates before the Unix epoch, should I use timestamp, as java.sql.Date doesn't store anything before 1970? Do date functions support timestamp as well as date? See: https://docs.oracle.com/javase/7/docs/api/java/sql/Date.html See also:

RE: Dates before epoch - java.sql.Date

2018-02-13 Thread Williams, Michael
Nevermind, I made an error, works fine. Mike From: Williams, Michael Sent: Tuesday, February 13, 2018 3:24 PM To: user@ignite.apache.org Subject: Dates before epoch - java.sql.Date If I need to store dates before the Unix epoch, should I use timestamp, as java.sql.Date doesn't store anything

RE: Cat Example

2018-02-09 Thread Williams, Michael
Rpltax56uFYU6n57c3GFvMdyEV-dz2ez2lZZpYl0=66Y7rAlRA_17xECa5FjIVnychzFgOU57cX95e0xK8Uw=QhZ2-mbmH1uyk6d0ECo3A_ghgTh1iNv1YQUGMYYx_NY=> On Fri, Feb 9, 2018 at 2:56 PM, Williams, Michael <michael.willi...@transamerica.com<mailto:michael.willi...@transamerica.com>> wrote: Is it possible

RE: Cat Example

2018-02-09 Thread Williams, Michael
FaQ=9g4MJkl2VjLjS6R4ei18BA=ipRRuqPnuP3BWnXGSOR_sLoARpltax56uFYU6n57c3GFvMdyEV-dz2ez2lZZpYl0=Nrv7gL0zYS9bFUir2zKHmI30_jJzYTzlic8Vk0kWonQ=UZWx1Uz419uytrzu-xRfSiuRqc3rszCQr5rJqNjT8TI=> The cache name is used for IgniteCache APIs and other related methods. — Denis On Feb 8, 2018, at 3:48 PM, Wil

Cat Example

2018-02-08 Thread Williams, Michael
Hi, Quick question, submitted a ticket earlier. How would I modify the below code such that, when viewed through Sql (dbeaver, eg) it behaves as if it had been created through a CREATE TABLE statement, where the name of the table was catCache? I'm trying to directly populate a series of tables