Re: [Monetdb-developers] some questions

2012-09-11 Thread Martin Kersten
Hi There is no such thing as a free lunch, certainly not for a 1M lines of code base :) On 9/12/12 12:27 AM, guangliang peng wrote: > hi, > i am a new learner of monetdb.And i have some questions below. > > 1when I ran some queries on monetdb,I found that the memory was > automa

Re: [Monetdb-developers] MonetDB: default - Removed histogram module: it's not even compi...

2012-08-09 Thread Martin Kersten
uage governing rights and limitations > - * under the License. > - * > - * The Original Code is the MonetDB Database System. > - * > - * The Initial Developer of the Original Code is CWI. > - * Portions created by CWI are Copyright (C) 1997-July 2008 CWI. > - * Copyright Au

Re: [Monetdb-developers] MonetDB: default - Added missing stuff

2012-07-26 Thread Martin Kersten
anges: removed references to "trace" optimizer > > > Where the changes indeed intended as done, "despite" the log message > > > Stefan > > > On Thu, Jul 26, 2012 at 10:39:15AM +0200, Martin Kersten wrote: >> Changeset: 7ad5e675d7e4 for MonetDB >

Re: [Monetdb-developers] MonetDB: default - Partial de-mx batmtime

2012-07-18 Thread Martin Kersten
On 7/18/12 10:53 AM, Stefan Manegold wrote: > Just wondering ... (and trying to learn): >> address MTIMEbat_@1_@3 >> comment "Compare a bat of @1 against each other"; >> command batcalc.@2( l:bat[:oid,:@1], r:@1) :bat[:oid,:bit] >> address MTIMEbat_@1_@3_cst; >> -command batcalc.@2( l:ba

Re: [Monetdb-developers] MonetDB: default - test opt_sql_append: trying to upgrade to new...

2012-02-18 Thread Martin Kersten
The new optimizer infrastructure returns the name of the pipe, not its content. The definitions can be obtained from the system view: select * from optimizers(); can be used to get the expanded form. On 2/18/12 6:11 PM, Stefan Manegold wrote: > Changeset: 62a52aaf4241 for MonetDB > URL: http://

Re: [Monetdb-developers] MonetDB: default - More advice on the optimizer template.

2012-02-11 Thread Martin Kersten
My comments are mostly advisory for optimizers in general ;) On 2/11/12 3:11 PM, Stefan Manegold wrote: > On Sat, Feb 11, 2012 at 02:06:17PM +0100, Martin Kersten wrote: >> >> >> On 2/11/12 11:03 AM, Stefan Manegold wrote: >>> On Wed, Feb 08, 2012 at 10:27:11

Re: [Monetdb-developers] MonetDB: default - More advice on the optimizer template.

2012-02-11 Thread Martin Kersten
>>> + * you have to path the file accordingly. > "path" >> >> parse? patch -- Virtualization & Cloud Management Using Capacity Planning Cloud computing makes use of virtualization - but cloud computing also focuses

Re: [Monetdb-developers] MonetDB: jacqueline - mal: allow command calls up to 16 arguments

2012-01-27 Thread Martin Kersten
at some point commands should become patterns. There is no limitation on the number of arguments per se. On 1/27/12 10:14 PM, Fabian Groffen wrote: > Changeset: a9fa1c35a273 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=a9fa1c35a273 > Modified Files: > monetdb5/mal/

Re: [Monetdb-developers] Can't start the database after build

2011-10-11 Thread Martin Kersten
On 10/11/2011 08:53 AM, Fabian Groffen wrote: > Hi Mark, > > On 10-10-2011 19:17:47 -0500, Mark Kerzner wrote: >> I've built the latest code from Mercurial repository, and I cannot get any >> database to start. I am doing everything locally, so this sequence of >> commands invariably results in t

Re: [Monetdb-developers] How to create a binary load files with string values?

2011-10-06 Thread Martin Kersten
Dear Mark, Overall, the attachment was put in place for exceptional cases e.g. a TB-size table coming from a scientific instrument. In most situations we have seen that a csv load is fast enough, it runs in parallel. However, i am working on a completion of the missing functionality. As said the

Re: [Monetdb-developers] Django adapter for MonetDB 11.3.1

2011-05-30 Thread Martin Kersten
Dear Marco Thank you for your contribution ! regards, Martin On 5/30/11 12:32 PM, Marco Quartulli wrote: > Dear all, > an adapter to the Django web development framework for MonetDB 11.3.1 > is available at > > https://github.com/marcoq/monetdb-python > > The code is functional and already

[Monetdb-developers] draft message

2011-03-01 Thread Martin Kersten
significantly. To assess the consequences in the community we would like to learn about projects that directly address the MAL or GDK layer. Please send us an email at i...@monetdb.org with the project highlights. regards, Martin Kersten

Re: [Monetdb-developers] Parallel insertions in monetdb table - some records do not insert

2010-06-14 Thread Martin Kersten
Hello, This 'issue' is raised several times,e.g. http://www.mail-archive.com/monetdb-developers@lists.sourceforge.net/msg02219.html Google: monetdb optimistic concurrency for more references about how optimistic concurrency control can not support your intended OLTP behavior. You probably have

Re: [Monetdb-developers] mx tool status and future

2010-06-01 Thread Martin Kersten
the mx code is old and the version you mentiom even more. Mx will remain used in the forseeable future regards martin On 27 mei 2010, at 08:37, Alex Dubov wrote: > Greetings. > > I understand, that this issue was probably discussed before, but I > couldn't quite find a way to search the l

Re: [Monetdb-developers] MonetDB: default - Revert the changes of May 04 to recover perfo...

2010-05-08 Thread Martin Kersten
Stefan Manegold wrote: > In case the changes of May 04 indeed caused the reported performance > degradation, I assume this checkin should then also be back-ported to the > Jun2010 branch that was created on May 06 and hence also contains the > problematic changes of May 04, right? yes. > > Once co

Re: [Monetdb-developers] regarding debugging

2010-04-04 Thread Martin Kersten
Puneet Birwa wrote: > hello, > can i use ecllipse for debugging the monetdb code. i.e can i > run the monetdb with the help of ecllipse. if yes please can somebody > tell how can i do it. plz reply soon . Please consult them http://dsl.serc.iisc.ernet.in/~course/DBMS/admin/ta.html > >

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/kernel batcast.mx, Feb2010, 1.31.2.7, 1.31.2.8

2010-03-20 Thread Martin Kersten
Stefan Manegold wrote: > On Sat, Mar 20, 2010 at 12:53:12PM +0000, Martin Kersten wrote: >> Update of /cvsroot/monetdb/MonetDB5/src/modules/kernel >> In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv10537 >> >> Modified Files: >> Tag: Feb2010 &

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/conf monetdb5.conf.in, , 1.86, 1.87

2010-03-14 Thread Martin Kersten
Fabian Groffen wrote: > On 14-03-2010 10:47:43 +0100, Martin Kersten wrote: >> Fabian Groffen wrote: >>> On 14-03-2010 08:23:57 +0000, Martin Kersten wrote: >>>> Update of /cvsroot/monetdb/MonetDB5/conf >>>> In directory sfp-cvsdas-1.v30.ch3.sourceforg

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/conf monetdb5.conf.in, , 1.86, 1.87

2010-03-14 Thread Martin Kersten
Fabian Groffen wrote: > On 14-03-2010 08:23:57 +0000, Martin Kersten wrote: >> Update of /cvsroot/monetdb/MonetDB5/conf >> In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv1052 >> >> Modified Files: >> monetdb5.conf.in >> Log Message: &g

Re: [Monetdb-developers] SQL concurrency/serialization

2010-02-25 Thread Martin Kersten
Isidor Zeuner wrote: > Dear MonetDB developers, Dear Isidor, MonetDB/SQL follows an optimistic concurrency control scheme. One of the properties of OCC is that it does not lock the database, except for validation of potential conflicts between the r/w sets. As such, it favors low update frequency.

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_mapreduce.mx, , 1.13, 1.14

2010-02-24 Thread Martin Kersten
Fabian wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv10474 > > Modified Files: > opt_mapreduce.mx > Log Message: > One of the optimisers > 'inline,remap,evaluate,costModel,coercions,emptySet,aliases' replaces a n

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_posix.mx, Feb2010, 1.176.2.21, 1.176.2.22 gdk_storage.mx, Feb2010, 1.149.2.32, 1.149.2.33

2010-02-18 Thread Martin Kersten
I applied the patches of Peter as of 1AM and started the SF100 run. It gave a segfault after 10minutes, but for once i did not attend Q1 to 'see/feel' processing. Rebuilding now with all patches of this night. Peter Boncz wrote: > Hi Stefan > > Thanks, indeed in all areas improvements are needed

Re: [Monetdb-developers] Single column select vs aggregation

2010-02-18 Thread Martin Kersten
Stefan Manegold wrote: > On Thu, Feb 18, 2010 at 07:05:47PM +0100, Stefan de Konink wrote: >> Op 18-02-10 18:23, Stefan Manegold schreef: >>> On Thu, Feb 18, 2010 at 05:46:31PM +0100, Stefan de Konink wrote: Attached is a trace of a single column select operation, with a max, avg and equa

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_posix.mx, Feb2010, 1.176.2.14, 1.176.2.15

2010-02-15 Thread Martin Kersten
Stefan Manegold wrote: > On Sun, Feb 14, 2010 at 09:23:10PM +0000, Martin Kersten wrote: >> Update of /cvsroot/monetdb/MonetDB/src/gdk >> In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv28118 >> >> Modified Files: >> Tag: Feb2010 >>

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/kernel group.mx, Feb2010, 1.146.2.14, 1.146.2.15

2010-02-14 Thread Martin Kersten
Stefan Manegold wrote: > when BATpreloading the sequentially accessed outer BAT, > make sure we also BATpreload the (often) randomly > accessed "inner" BAT We probably also have to inject advice for the target variable(s), because it is likely to be used in the future a BUF_WILLNEED might be appro

Re: [Monetdb-developers] BATpreload_ and _BATpreload

2010-02-14 Thread Martin Kersten
Sjoerd Mullender wrote: > I am quite unhappy with the names BATpreload, BATpreload_, and > _BATpreload. I really don't like names that differ only by an initial > or final _. I would much rather see more descriptive names. > BATpreload_ is now more an interface to give advice to the underlying >

Re: [Monetdb-developers] @= atomtostr memory usage

2010-02-10 Thread Martin Kersten
Stefan de Konink wrote: > Hi, > > > > If there are no objections, I'll check in that patch later today in head. >>From benchmarking point of view, it might be worthwhile to test with and > without the realloc. Refrain from checking in this patch. Martin > > > Stefan > > >

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/kernel batcast.mx, Feb2010, 1.31, 1.31.2.1 batstr.mx, Feb2010, 1.68, 1.68.2.1

2010-02-06 Thread Martin Kersten
Stefan Manegold wrote: > On Sat, Feb 06, 2010 at 10:17:54AM +0000, Martin Kersten wrote: >> Update of /cvsroot/monetdb/MonetDB5/src/modules/kernel >> In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv685 >> >> Modified Files: >> Tag: Feb2010 >

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_storage.mx, Feb2010, 1.149.2.5, 1.149.2.6

2010-01-31 Thread Martin Kersten
Stefan Manegold wrote: > On Sun, Jan 31, 2010 at 04:43:29PM +0000, Martin Kersten wrote: >> Update of /cvsroot/monetdb/MonetDB/src/gdk >> In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv28035 >> >> Modified Files: >> Tag: Feb2010 >>

Re: [Monetdb-developers] GDKupgradevarheap allocate/copy inconsistency

2010-01-22 Thread Martin Kersten
Isidor Zeuner wrote: [1] https://sourceforge.net/tracker/?func=detail&aid=2936616&group_id=56967&atid=482468 I saw the tracker item, and was wondering about it. What did you do to get into the situation? In other words, how can I reproduce? Unfortunately, I don't have an isolated failing c

Re: [Monetdb-developers] other than bug things...

2009-11-27 Thread Martin Kersten
Hello Wouter, Thank you for this positive message. It made my day :)) We would like to learn more about applications where MonetDB is working as planned. Giving the steady increasing monthly downloads there must be more of such cases in the field. regards, Martin Wouter Alink wrote: > Hello Dev

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/tests/BugTracker/Tests function_parameter_without_type.SF-1898518.stable.err, Nov2009, 1.2, 1.2.8.1 function_parameter_without_type.SF-1898518

2009-11-14 Thread Martin Kersten
Stefan Manegold wrote: > Update of /cvsroot/monetdb/pathfinder/tests/BugTracker/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv5625 > > Modified Files: > Tag: Nov2009 > function_parameter_without_type.SF-1898518.stable.err > function_parameter_without_type.SF-1898

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal/crackers crackers_partial_sideways.mx, , 1.7, 1.8

2009-11-09 Thread Martin Kersten
stratos wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal/crackers > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv26417 > > Modified Files: > crackers_partial_sideways.mx > Log Message: > more safety checks from coverity > > > Index: crackers_partial_sideways.mx >

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_authorize.mx, Nov2009, 1.82.4.3, 1.82.4.4

2009-11-03 Thread Martin Kersten
Fabian Groffen wrote: > On 03-11-2009 20:16:25 +0000, Martin Kersten wrote: >> Update of /cvsroot/monetdb/MonetDB5/src/mal >> In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv5258 >> >> Modified Files: >> Tag: Nov2009 >> mal_authorize.m

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_authorize.mx, Nov2009, 1.82.4.3, 1.82.4.4

2009-11-03 Thread Martin Kersten
Fabian Groffen wrote: > On 03-11-2009 22:22:54 +0100, Martin Kersten wrote: >> Fabian Groffen wrote: >>> On 03-11-2009 20:16:25 +0000, Martin Kersten wrote: >>>> Update of /cvsroot/monetdb/MonetDB5/src/mal >>>> In directory 23jxhf1.ch3.sourceforge.com:

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_authorize.mx, Nov2009, 1.82.4.1, 1.82.4.2 mal_box.mx, Nov2009, 1.98.4.1, 1.98.4.2 mal_factory.mx, Nov2009, 1.89.6.1, 1.89.6.2 mal_sessi

2009-10-31 Thread Martin Kersten
Fabian Groffen wrote: > On 31-10-2009 09:06:11 +0000, Martin Kersten wrote: > [snip] >> obj->name= GDKstrdup(name); > > what if the GDKstrdup fails here? > >> obj->sym= newMalBlk(MAXVARS,STMT_INCREMENT); >> obj->val = newGlobalSta

Re: [Monetdb-developers] How to register new "bulk" function with SQL?

2009-10-22 Thread Martin Kersten
The remap optimizer gives an overview and solution to this problem. It has currently some hardwired assumptions, e.g. it would search for bat bulk operations only. If you would rename geom.point into batgeom.point for the bulk version, you should have reached your goal. Stefan Manegold wrote: > H

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal/Tests pithole.mal, Aug2009, NONE, 1.1.2.1 All, Aug2009, 1.113, 1.113.2.1

2009-09-06 Thread Martin Kersten
nog geen tijd en nu geen internet (behalve iphone) On 6 sep 2009, at 10:55, Stefan Manegold wrote: > Martin, > > this checkin seems to contain only the new test. > Did you by accident forget to checkin the related code changes? > > Stefan > > On Sun, Sep 06, 2009 at

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal tablet.mx, , 1.226, 1.227

2009-08-14 Thread Martin Kersten
ators all together or to rely on the user to deal with these corner cases > which is two fields separated by a comma. > > On 2009-08-14 08:17, Martin Kersten wrote: >> Update of /cvsroot/monetdb/MonetDB5/src/modules/mal >> In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal tablet.mx, , 1.208, 1.209

2009-08-10 Thread Martin Kersten
I was careful to idemtify a bug in Malinterpreter.THE remainder is a Large list dwaling with the copy command which is finishes On 10 aug 2009, at 10:02, Sjoerd Mullender wrote: > Was this a current-only bug or should this be backported? > > On 2009-08-07 16:16, Niels Nes wrote: >> Update of

Re: [Monetdb-developers] GooglePerformanceTools with MonetDB?

2009-08-04 Thread Martin Kersten
Furthermore, most malloced structures in MAL are all recycled cheaply. Fabian Groffen wrote: > On 04-08-2009 19:53:12 +0200, Stefan de Konink wrote: >> GooglePerformanceTools gives an alternative (threaded) implementation of >> malloc under a BSD License. Has it even been tested with MonetDB befor

Re: [Monetdb-developers] GooglePerformanceTools with MonetDB?

2009-08-04 Thread Martin Kersten
Chunk based (m)allocation of structures was part of MonetDB version 1. Stefan de Konink wrote: > GooglePerformanceTools gives an alternative (threaded) implementation of > malloc under a BSD License. Has it even been tested with MonetDB before? > > http://code.google.com/p/google-perftools/wiki/G

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_octopus.mx, , 1.57, 1.58 opt_macro.mx, , 1.47, 1.48

2009-07-29 Thread Martin Kersten
Fabian Groffen wrote: > On 29-07-2009 20:19:48 +0000, Martin Kersten wrote: >> octopus - check if the head is managed by merovingian > >> -if (list == NULL || needed == NULL){ >> +/* check if the head is properly administered for Octopus */ >> +S

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal algebraExtensions.mx, , 1.60, 1.61

2009-07-28 Thread Martin Kersten
Should i restart the 400Mx400M experiment? I see a lot of BBPtrims passing by Stefan Manegold wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal > In directory > 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv1551/MonetDB5/src/modules/mal > > Modified Files: > algebraExtensions.mx >

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/kernel unix.mx, , 1.24, 1.25

2009-07-28 Thread Martin Kersten
with the disk. This function doesn't do anything with memory management > within the process. > > Furthermore, this function is not available on Windows. was to experiment with the blkjoin issues, it can be dropped again. > > Martin Kersten wrote: >> Update of /cvsroot/

[Monetdb-developers] Deployment of MonetDB

2009-06-18 Thread Martin Kersten
appreciate if you could replay with a short message how you deploy the software and your top priorities for a next release. Thank you for you cooperation, Martin Kersten -- Crystal Reports - New Free Runtime and 30 Day Trial

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5/merovingian monetdb.c, , 1.12, 1.13

2009-06-06 Thread Martin Kersten
octopus errors on sql test set down to 50 -- OpenSolaris 2009.06 is a cutting edge operating system for enterprises looking to deploy the next generation of Solaris that includes the latest innovations from Sun and the O

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_interpreter.mx, , 1.303, 1.304

2009-05-23 Thread Martin Kersten
Sjoerd Mullender wrote: > Is this a bug fix? no bug report has been given, it is just a little more defensiveness. > > On 2009-05-23 11:56, Martin Kersten wrote: >> Update of /cvsroot/monetdb/MonetDB5/src/mal >> In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv19871

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_authorize.mx, , 1.73, 1.74 mal_client.mx, , 1.195, 1.196 mal_debugger.mx, , 1.263, 1.264 mal_exception.mx, , 1.54, 1.55 mal_factory.mx,

2009-05-16 Thread Martin Kersten
Fabian Groffen wrote: > On 16-05-2009 22:49:17 +0200, Martin Kersten wrote: >> Fabian Groffen wrote: >>> On 16-05-2009 22:28:29 +0200, Martin Kersten wrote: >>>>> Why not do it the gettext way, in that case? >>>> Yes, i am fully aware of gettext. &g

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_authorize.mx, , 1.73, 1.74 mal_client.mx, , 1.195, 1.196 mal_debugger.mx, , 1.263, 1.264 mal_exception.mx, , 1.54, 1.55 mal_factory.mx,

2009-05-16 Thread Martin Kersten
Fabian Groffen wrote: > On 16-05-2009 22:28:29 +0200, Martin Kersten wrote: >>> Why not do it the gettext way, in that case? >> Yes, i am fully aware of gettext. >> It is a multi-step process, first condense. >> and gettext() performs translations based o

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_authorize.mx, , 1.73, 1.74 mal_client.mx, , 1.195, 1.196 mal_debugger.mx, , 1.263, 1.264 mal_exception.mx, , 1.54, 1.55 mal_factory.mx,

2009-05-16 Thread Martin Kersten
Fabian Groffen wrote: > On 16-05-2009 18:26:25 +0000, Martin Kersten wrote: >> Update of /cvsroot/monetdb/MonetDB5/src/mal >> In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv27406 >> >> Modified Files: >> mal_authorize.mx mal_client.mx mal_debu

Re: [Monetdb-developers] Suggestion to ditch SHA-1, and embrace SHA-2

2009-05-09 Thread Martin Kersten
Fabian Groffen wrote: > On 09-05-2009 11:43:14 +0200, Stefan de Konink wrote: >> Fabian Groffen wrote: >>> On 08-05-2009 19:54:38 +0200, Stefan de Konink wrote: As already found in the news SHA-1 is advised to migrated off by 2010. I would suggest SHA-2 in protocol 9. >>> Which one of th

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal remote.mx, , 1.96, 1.97

2009-05-05 Thread Martin Kersten
Fabian Groffen wrote: > On 05-05-2009 12:31:13 +0000, Martin Kersten wrote: >> -if (mapi_error(conn) != MOK) >> +if (mapi_error(conn) != MOK){ >> +mapi_explain(conn,stderr); > > better ifdef such statements IMO... # MonetDB/SQL module v2.29.0 loaded

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal remote.mx, , 1.96, 1.97

2009-05-05 Thread Martin Kersten
Fabian Groffen wrote: > On 05-05-2009 12:31:13 +0000, Martin Kersten wrote: >> -if (mapi_error(conn) != MOK) >> +if (mapi_error(conn) != MOK){ >> +mapi_explain(conn,stderr); > > better ifdef such statements IMO... ja. probeer

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal remote.mx, , 1.87, 1.88

2009-04-19 Thread Martin Kersten
Fabian Groffen wrote: > On 19-04-2009 18:56:59 +0000, Martin Kersten wrote: >> Log Message: >> The client context record is shared between threads. This means that you >> have to protect the structure when connection lists are initialized/used. > > "The client

Re: [Monetdb-developers] Another big group by query

2009-04-13 Thread Martin Kersten
Stefan de Konink wrote: > Stefan Manegold wrote: >> counting the size of 362105182 groups over 365652137 BUNs ... >> >> The sum of all shown times is "only" 116865583 usec (i.e., just under 2 min). > > Then it is likely the output misses the last actual 'big time consumer', > while Martin suggest

Re: [Monetdb-developers] Another big group by query

2009-04-12 Thread Martin Kersten
Stefan Manegold wrote: > On Sun, Apr 12, 2009 at 03:15:36AM +0200, Stefan de Konink wrote: >> Hi All, >> >> >> Might be better to go by the mailinglist instead of adding many people >> to the CC. > > Good. Exactly that is why we have mailing lists ;-) > >> Currently I am running the latest CVS c

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk.mx, , 1.278, 1.279 gdk_bat.mx, , 1.213, 1.214 gdk_posix.mx, , 1.168, 1.169 gdk_relop.mx, , 1.161, 1.162 gdk_utils.mx, , 1.241, 1.242

2009-04-03 Thread Martin Kersten
Peter Boncz wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv31767/gdk > > Modified Files: > gdk.mx gdk_bat.mx gdk_posix.mx gdk_relop.mx gdk_utils.mx > Log Message: > various tweaks to the memory mangement > > - tune the GDK_mmap_m

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_derivepath.mx, Feb2009, NONE, 1.1.2.1 Makefile.ag, Feb2009, 1.66, 1.66.2.1 opt_prelude.mx, Feb2009, 1.55.2.3, 1.55.2.4

2009-03-05 Thread Martin Kersten
Sjoerd Mullender wrote: > How is this not a new feature? Oops, yes, unless Stefan wants this in for McK > > Martin Kersten wrote: >> Update of /cvsroot/monetdb/MonetDB5/src/optimizer >> In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv2998/optimizer >> >

Re: [Monetdb-developers] monetdb-client for python doesn't seem to work for booleans.

2009-02-23 Thread Martin Kersten
Vikram Bhandoh wrote: > Hi I've been working on a django backend for monetdb. For people who are > interested in it have a look at it > http://github.com/vikram/monetdb/tree/master > thank you for your contribution. > I found a couple of issues with the python monetdb-client which are > importa

Re: [Monetdb-developers] [MonetDB-users] COPY INTO on aggregate queries crashes MonetDB

2009-01-04 Thread Martin Kersten
Dear Peter, The problem mentioned could be reproduced. It is clearly a bug and registered as such in test copy-count.SF-2485215.sql. It seems a bug in the code generator of SQL. The progress can be followed in the sourceforge bugtracker. Thanks for using the MonetDB package and helping to improve

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/mapiclient MapiClient.mx, , 1.130, 1.131

2008-12-13 Thread Martin Kersten
Stefan Manegold wrote: > On Sat, Dec 13, 2008 at 03:50:22PM +0000, Martin Kersten wrote: >> Update of /cvsroot/monetdb/clients/src/mapiclient >> In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv11819/mapiclient >> >> Modified Files: >> MapiClient.mx >

Re: [Monetdb-developers] gridsql

2008-12-09 Thread Martin Kersten
Stefan de Konink wrote: > [EMAIL PROTECTED] wrote: >> Can you have a 1-2 hour look at gridsql if it is feasible at all. >> If so, let's push Venks ;) >> otherwise avoid the frustration for him. > > Here you mean to be able to use a MAPI driver? Or even use the JDBC driver. > > > Stefan --

[Monetdb-developers] gridsql

2008-12-09 Thread Martin . Kersten
Can you have a 1-2 hour look at gridsql if it is feasible at all. If so, let's push Venks ;) otherwise avoid the frustration for him. -- SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada. The f

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_instruction.mx, , 1.372, 1.373

2008-11-26 Thread Martin Kersten
Yes, that was known. The little/big endian code is not needed here is the hypothesis. Any such difference should be handled in the GDK layer. Stefan Manegold wrote: > On Wed, Nov 26, 2008 at 08:21:17PM +0000, Martin Kersten wrote: > >> Update of /cvsroot/monetdb/MonetDB5/s

Re: [Monetdb-developers] Monetdb-developers Digest, Vol 30, Issue 10

2008-11-23 Thread Martin Kersten
Peter Boncz wrote: > Hi Stefan (the non-german .de one) > > session. > > I also recall that in case of the Skyserver TB dataset, key checking was > disabled to to similar problems. > No. The key checking was initially turned off, because the hash table (32-bit) could not well cope with the 1

Re: [Monetdb-developers] Could not create hash table for key test

2008-11-23 Thread Martin Kersten
Stefan de Konink wrote: > On Sun, 23 Nov 2008, Martin Kersten wrote: > > >> Stefan de Konink wrote: >> >>> #BBPTRIM_ENTER: memsize=180224,vmsize=14397997056 >>> #BBPTRIM: memtarget=0 vmtarget=0 >>> #BBPTRIM_EXIT: memsize=20365312,vmsize=14

Re: [Monetdb-developers] Could not create hash table for key test

2008-11-23 Thread Martin Kersten
Stefan de Konink wrote: > #BBPTRIM_ENTER: memsize=180224,vmsize=14397997056 > #BBPTRIM: memtarget=0 vmtarget=0 > #BBPTRIM_EXIT: memsize=20365312,vmsize=14397997056 > #BBPTRIM_ENTER: memsize=2496368440,vmsize=16874000184 > #BBPTRIM: memtarget=778092856 vmtarget=0 > #BBPTRIM_EXIT: memsize=20365312,vm

Re: [Monetdb-developers] Could not create hash table for key test

2008-11-22 Thread Martin Kersten
Dear Stefan, Let's explain as far as possible. Stefan de Konink wrote: > #GDKmalloc(14777222432) fail => BBPtrim(enter) > usage[mem=14840896,vm=27527806976] > #BBPTRIM_ENTER: memsize=14840896,vmsize=27527806976 > #BBPTRIM: memtarget=4611686018427387904 vmtarget=0 > #BBPTRIM_EXIT: memsize=191201

Re: [Monetdb-developers] MAPI protocol suggestion

2008-11-22 Thread Martin Kersten
Stefan de Konink wrote: > Martin Kersten wrote: >> Consequently, moving to a binary protocol is not >> warranted by comparison, nor effective in terms >> of performance improvement. 50% of the cost in >> MonetDB for these queries are the SQL parser and >> quer

Re: [Monetdb-developers] MAPI protocol suggestion

2008-11-22 Thread Martin Kersten
LS, The question about binary versions of MAPI has recently been raised and a test was performed based on sending a large sequence of small SQL queries involving integers and strings. On 21-10-2008 15:47:02 +0200, Fabian Groffen wrote: > > 10 "select 1" using 1 connection over standard clien

Re: [Monetdb-developers] Transactions

2008-11-13 Thread Martin Kersten
Eric M. Hielscher wrote: > Hi all, > > My name is Eric Hielscher, and I'm a PhD student working on a database > project. The goal will be to replace the transaction processing > subsystem of a dbms, and I've decided to use MonetDB. I've yet to > Hi Eric, I first would like to point you to the

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server sql_env.mx, Nov2008, 1.74, 1.74.2.1

2008-11-05 Thread Martin Kersten
It will change again ;) see in my local dir Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/server > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv17857/src/server > > Modified Files: > Tag: Nov2008 > sql_env.mx > Log Message: > keepCall now has 12 arguments > > > U sql_

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB4/src/modules/contrib malalgebra.mx, MonetDB_4-24, 1.8.2.1, 1.8.2.2

2008-10-29 Thread Martin Kersten
I would only move items into the development trunk that are part of GDK. Stefan Manegold wrote: > On Wed, Oct 29, 2008 at 10:27:35AM +0100, Stefan Manegold wrote: > >> Gents, >> >> given (1) the inherent incompatibility between the PF_ROX branch (forked of >> the XQuery_0-24 branch of pathfinde

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_posix.mx, , 1.157, 1.158

2008-10-25 Thread Martin Kersten
Fabian Groffen wrote: > On 25-10-2008 14:04:29 +0200, Stefan Manegold wrote: > >> On Sat, Oct 25, 2008 at 07:30:50AM +0000, Martin Kersten wrote: >> >>> Update of /cvsroot/monetdb/MonetDB/src/gdk >>> In directory 23jxhf1.ch3.sourceforge.com:/tmp/

Re: [Monetdb-developers] slow query log

2008-10-21 Thread Martin Kersten
Stefan de Konink wrote: > Is there currently a syntax to log every incoming SQL query to a file? > > I found options like: > 1) ODBCDEBUG [1] > 2) mapi_log(...) [2] > mclient links into the Linux history mechanism and logfile may help > > But is there something easy to capture all incoming query

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/conf monetdb5.conf.in, , 1.34, 1.35

2008-10-12 Thread Martin Kersten
Niels Nes wrote: > On Sun, Oct 12, 2008 at 02:14:17PM +0200, Fabian Groffen wrote: > >> On 12-10-2008 13:48:14 +0200, Martin Kersten wrote: >> >>>>> [EMAIL PROTECTED]@@[EMAIL PROTECTED]@[EMAIL PROTECTED] >>>>> [EMAIL PROTECTED]@@[EMAIL PRO

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5 merovingian.mx, , 1.58, 1.59 monetdb.mx, , 1.27, 1.28

2008-10-12 Thread Martin Kersten
Fabian Groffen wrote: > On 12-10-2008 10:31:31 +0000, Martin Kersten wrote: > >> Update of /cvsroot/monetdb/sql/src/backends/monet5 >> In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv23781 >> >> Modified Files: >> merovingian.mx monetdb.mx >>

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/conf monetdb5.conf.in, , 1.34, 1.35

2008-10-12 Thread Martin Kersten
Fabian Groffen wrote: > On 12-10-2008 09:38:04 +0000, Martin Kersten wrote: > >> Update of /cvsroot/monetdb/MonetDB5/conf >> In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv19179 >> >> Modified Files: >> monetdb5.conf.in >> Log Message: >

Re: [Monetdb-developers] COPY, terminating connection

2008-09-14 Thread Martin Kersten
Fabian Groffen wrote: > On 13-09-2008 07:36:19 +0200, Stefan Manegold wrote: > >>> Is there anything im doing wrong ? I have the feeling there must be too >>> many connections crashing the system .. coz after that i can't use mclient >>> anymore, i have to restart the DB. >>> >> How man

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal bpm.mx, , 1.137, 1.138 mal_mapi.mx, , 1.16, 1.17

2008-09-11 Thread Martin Kersten
Stefan Manegold wrote: > On Wed, Sep 10, 2008 at 07:06:16PM +0000, Martin Kersten wrote: >> Update of /cvsroot/monetdb/MonetDB5/src/modules/mal >> In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv20655 >> >> Modified Files: >> bpm.mx mal_mapi.mx >&g

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal/Tests tst026.stable.out, , 1.5, 1.6 tst1505.stable.out, , 1.25, 1.26 tst220.stable.out, , 1.39, 1.40 tst280.stable.out, , 1.28, 1.29 tst903

2008-09-06 Thread Martin Kersten
Stefan Manegold wrote: > On Sat, Sep 06, 2008 at 11:22:09AM +0000, Martin Kersten wrote: > >> Update of /cvsroot/monetdb/MonetDB5/src/mal/Tests >> In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv8410/mal/Tests >> >> Modified Files: >> tst026.

Re: [Monetdb-developers] Bug report: Poor query performance

2008-08-31 Thread Martin Kersten
Elad . wrote: > > Hi, > > I have a database with 52 columns and 7 million rows. dear Elad, Thanks for using MonetDB. The problem you describe is known. No easy solution exists, because the front-end optimizer does not use, nor rely on table statistics to derive the best plan. A solution will

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5 merovingian.mx, , 1.53, 1.54

2008-08-30 Thread Martin Kersten
Interesting step. Pushes me forward after i have solved some issues, like reading thesi Fabian wrote: > Update of /cvsroot/monetdb/sql/src/backends/monet5 > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv11537 > > Modified Files: > merovingian.mx > Log Message: > Merovingian

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal/Tests tst052.mal, , 1.1, 1.2 tst052.stable.out, , 1.1, 1.2

2008-08-04 Thread Martin Kersten
Stefan Manegold wrote: > On Tue, Aug 05, 2008 at 06:22:32AM +0000, Martin Kersten wrote: > >> Update of /cvsroot/monetdb/MonetDB5/src/mal/Tests >> In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv9480 >> >> Modified Files: >> tst052.mal tst052.sta

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/atoms xml.mx, , 1.21, 1.22

2008-08-03 Thread Martin Kersten
Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/atoms > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv1588 > > Modified Files: > xml.mx > Log Message: > By using the correct types, you loose a lot of casts... > Point is that strings in GDK ValRecord are

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/atoms blob.mx, , 1.43, 1.44 str.mx, , 1.76, 1.77 xml.mx, , 1.19, 1.20

2008-07-30 Thread Martin Kersten
Stefan Manegold wrote: > On Wed, Jul 30, 2008 at 08:02:16AM +0000, Martin Kersten wrote: > >> Update of /cvsroot/monetdb/MonetDB5/src/modules/atoms >> In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv22933/atoms >> >> Modified Files: >> b

Re: [Monetdb-developers] tables/databases simultaneous updates & extended-stored-procedures

2008-07-19 Thread Martin Kersten
SOL ZADEH wrote: > > Thanks Neils for your prompt reply. > > Is there a quantified limitation on "insertions" on scenarios I > mentioned below (multiple tables/database)? > I.e. Does very frequent insertions on 2 or more tables (on same > database or other database on the same server) > in any wa

Re: [Monetdb-developers] JDBC connection error: Max number of redirects reached

2008-06-15 Thread Martin Kersten
Fabian Groffen wrote: > On 15-06-2008 10:21:50 -0700, Rt Ibmer wrote: > >>> Great. Then it is exactly what I thought: a bug I already >>> solved. You >>> can interchange the jdbcclient.jar with your >>> monetdb-jdbc-1.X.jar file. >>> The former contains the latter, and in your case, the >>> la

Re: [Monetdb-developers] [MonetDB-users] MonetDB Server dies on connect

2008-06-13 Thread Martin Kersten
Sjoerd, I was planning to try out the installers on my Vista machine. The previous version is v5.4.0 installed Uninstalling it gives the following error: There is a problem with this Windows Installer package. A program required for this install to complete could not be run. Contact your support

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5 sql_optimizer.mx, , 1.183, 1.184

2008-06-12 Thread Martin Kersten
Romulo Goncalves wrote: > Milena Ivanova wrote: > >> Update of /cvsroot/monetdb/sql/src/backends/monet5 >> In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv29777 >> >> Modified Files: >> sql_optimizer.mx >> Log Message: >> Switch off the recycler. >> > Why? > > We activated it t

Re: [Monetdb-developers] Calculate disk space for table?

2008-06-08 Thread Martin Kersten
Rt Ibmer wrote: > Hi - how can I tell how much disk storage space on of my tables is using? > > I tried one rough way but not sure if it is accurate. Basically I did a > linux du command this is the correct way until a fullfledged DBA tool is available or the necessary functions are packaged i

Re: [Monetdb-developers] Bug report - COPY RECORDS and encoded data

2008-06-07 Thread Martin Kersten
Rt Ibmer wrote: > I was going crazy trying to figure out why my COPY RECORDS command wasn't > working. Turns out it is caused from funny (encoded?) characters in the > string for one of the fields. > > For instance one of the fields contained this "?a?as?e??, 18 ?a??? 2001 > 10:24:00 pµ" > > Ho

Re: [Monetdb-developers] Default of "--enable-strict/--disable-strict" in release branch

2008-06-06 Thread Martin Kersten
Users should first and foremost find it easy to install and effective to build their applications. Power users, e.g. with very large database, complex queries, should be pointed towards a supportive documentation page to squeeze out more performance and the risk assesment. They are also the users

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_recycler.mx, , 1.23, 1.24

2008-05-27 Thread Martin Kersten
Stefan Manegold wrote: > Milena, > > is this a (bug-?) "fix" that should (have) go(ne) into the upcoming release > (and hence release branch)? > > The recycle code is still under development and not activated in the SQL optimizer by default. The Window errors are a reminder too. > Stefan > > >

Re: [Monetdb-developers] php5 interface

2008-05-09 Thread Martin Kersten
Michiel Kamermans wrote: > Martin, > > A test using windows XP with PHP 5.2.6 and MonetDB seems to work just > fine. I suspect that this means that in Vista monetDB won't be able to > interface with PHP either, as the core is essentially the same as the > one used in windows server 2008... I am

[Monetdb-developers] [Fwd: Re: php5 interface]

2008-05-09 Thread Martin Kersten
Original Message Subject:Re: php5 interface Date: Fri, 09 May 2008 19:13:40 +0200 From: Michiel Kamermans <[EMAIL PROTECTED]> To: Martin Kersten <[EMAIL PROTECTED]> References: <[EMAIL PROTECTED]> <[EMAIL PROTECTED]> Hi Mart

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/test/mapi/Tests php_monetdb.stable.out, , 1.6, 1.7 php_monetdb.stable.out.Five, , 1.6, 1.7

2008-04-01 Thread Martin Kersten
Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/test/mapi/Tests > In directory > sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv17226/src/test/mapi/Tests > > Modified Files: > php_monetdb.stable.out php_monetdb.stable.out.Five > Log Message: > removed 'explain' variable, ie no more set exp

Re: [Monetdb-developers] blobs performance

2008-03-29 Thread Martin Kersten
Dear Henrik Thank you for your interest in MonetDB. The context of your application is not evident from this short snippet so the answers are likely to be general. Henrik Vendelbo wrote: > I am working through the options for clustered file management. > > Normally I would expect fairly poor perf

Re: [Monetdb-developers] Experimental testweb history available

2008-03-19 Thread Martin Kersten
Fabian Groffen wrote: > Hi all, Thanks Fabian I hope it is a source for inspiration and archival explorations. The description should be added to the website documentation. regards, Martin > > This is just to inform you all of a recently added "feature" (to both > Stable and Current ;) ) in our

  1   2   >