Re: Creation stamp

2014-02-10 Thread Henrik Sarvell
the creation stamp be with regards to future lookups by way of start stamp and end stamp? It seems to me that using two relations might be optimal, one +Ref +Date and an extra +Ref +Time. Then a lookup could first use the +Date relation to filter out all transactions that weren't created

Re: Creation stamp

2014-02-10 Thread Alexander Burger
Hi Joe + Henrik, On Mon, Feb 10, 2014 at 06:37:34AM -0500, Joe Bogner wrote: If you end up speeding up please share. I know it's just a mock example so may not be worth the time. It's nice to have small reproducible examples. Oops! I just notice that the 'prune' semantics Henrik uses is

Re: Creation stamp

2014-02-10 Thread Henrik Sarvell
So by (735580 53948) you mean a +Ref +List? Is it possible to get a range by way of collect with that setup? I tested with two separate relations, ie one +Ref +Time and one +Ref +Date, the database file ended up the same size. On Mon, Feb 10, 2014 at 9:31 PM, Alexander Burger

Re: Creation stamp

2014-02-10 Thread Alexander Burger
On Mon, Feb 10, 2014 at 09:57:13PM +0700, Henrik Sarvell wrote: So by (735580 53948) you mean a +Ref +List? Is it possible to get a range by way of collect with that setup? No, not a +Ref +List. As I propoesed on Feb 08 (rel d (+Aux +Ref +Date) (t)) # Date (rel t (+Time)) #

Re: Creation stamp

2014-02-10 Thread Joe Bogner
Hey Alex - On Mon, Feb 10, 2014 at 9:31 AM, Alexander Burger a...@software-lab.dewrote: Also, you can save quite some time if you pre-allocate memory, to avoid an increase with each garbage collection. I would call (gc 800) in the beginning, to allocate 800 MB, and (gc 0) in the end.

Re: Creation stamp

2014-02-10 Thread Henrik Sarvell
The index file is 1.3GB in the +Bag case, 2GB in the +String case, doesn't seem like a big deal to me given that the main entity file ends up being 32GB. Now I haven't checked, but due to the relative size of the files the range query might be comparably faster but in my case a tenth of a second

Re: Creation stamp

2014-02-09 Thread Henrik Sarvell
transactions, what would be the quickest way of handling the creation stamp be with regards to future lookups by way of start stamp and end stamp? It seems to me that using two relations might be optimal, one +Ref +Date and an extra +Ref +Time. Then a lookup could first use the +Date relation

Re: Creation stamp

2014-02-08 Thread Alexander Burger
Hi Henrik, On Fri, Feb 07, 2014 at 08:29:07PM +0700, Henrik Sarvell wrote: Given a very large amount of external objects, representing for instance transactions, what would be the quickest way of handling the creation stamp be with regards to future lookups by way of start stamp and end stamp

Creation stamp

2014-02-07 Thread Henrik Sarvell
Given a very large amount of external objects, representing for instance transactions, what would be the quickest way of handling the creation stamp be with regards to future lookups by way of start stamp and end stamp? It seems to me that using two relations might be optimal, one +Ref +Date