Re: [Monetdb-developers] undefined symbol: BATaccess

2012-08-04 Thread Stefan de Konink
hg update tip, ./de-bootstrap, ./bootstrap, ./configure did the trick. Critical part was the bootstrap-sequence. Stefan -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security a

Re: [Monetdb-developers] undefined symbol: BATaccess

2012-08-04 Thread Stefan de Konink
And updating to tip results in: libtool: link: gcc -g -Werror -Wall -Wextra -W -Werror-implicit-function-declaration -Wpointer-arith -Wdeclaration-after-statement -Wundef -Wformat=2 -Wno-format-nonliteral -Winit-self -Winvalid-pch -Wmissing-declarations -Wmissing-format-attribute -Wmissing-pro

[Monetdb-developers] undefined symbol: BATaccess

2012-08-04 Thread Stefan de Konink
Was this already known? # MonetDB 5 server v11.12.0 # This is an unreleased version # Serving database 'kvk-2012-augustus', using 2 threads # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked # Found 3.860 GiB available main-memory. # Copyright (c) 1993-July 2008 CWI.

[Monetdb-developers] Why is the sourcecode 'de-mx-ed'?

2012-07-16 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 The MonetDB checkins show over time a lot of de-mx operations. Why is the preprocessor language being abandoned in favor of 'native' macro's? Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.18 (GNU/Linux) Comment: Using GnuPG with Mozilla

[Monetdb-developers] Extending TimeStamp and Time to support 24+ hour days

2011-12-14 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 In some fields the usage of 32 or 36 hours in a day are common. The extra time after midnight is used to indicate that a certain operation is linear in time. My particular use case is public transport. Is there any other way that using TIMESTAMP to

Re: [Monetdb-developers] monetdbd takes too long to start

2011-12-12 Thread Stefan de Konink
Can you also check what happens if you add to /etc/resolv.conf: options single-request (Just to exclude it is not some form of glibc 2.10+ dns/firewall issue.) Stefan -- Learn Windows Azure Live! Tuesday, Dec 13, 2011

Re: [Monetdb-developers] monetdbd takes too long to start

2011-12-09 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 10-12-11 03:02, Charalampos Nikolaou schreef: > Have you investigated this issue? Do you know what causes such a > delay? Is it present in other OSs too? On Ubuntu, is by any chance IPv6 enabled? This could already count for a 5s resolving time-

Re: [Monetdb-developers] Search MonetDB Source - character processing at light speed :-)

2011-03-21 Thread Stefan de Konink
On Mon, 21 Mar 2011, Arjen P. de Vries wrote: > Feel free to use the suffix array search demo of the MonetDB source > tree where you see fit: > http://devel.spinque.com/SearchMonetDBSource/ > The index is refreshed every night! Is there a nice tutorial how to setup this index for other projects?

Re: [Monetdb-developers] updating the default branch.

2010-11-25 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 25-11-10 12:53, Fabian Groffen schreef: > On 25-11-2010 12:49:57 +0100, Stefan de Konink wrote: >> Anyway without cleaning up my: >> /opt/monetdb-whatever >> >> I sometimes get issues too, build dirs are always remov

Re: [Monetdb-developers] updating the default branch.

2010-11-25 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 25-11-10 12:37, Romulo Goncalves schreef: > I my build dir is inside the prefix dir. > > I do > rm $prefix > mkdir -p $prefix/build If this is pseudo code or not. -r is missing in the above rm statement. Anyway without cleaning up my: /opt/mone

Re: [Monetdb-developers] updating the default branch.

2010-11-25 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 25-11-10 11:56, Romulo Goncalves schreef: > I just updated my default branch and I restarted my mserver, i.e., it will > use a old dbfarm. > I get the following complain: > !MALException:user.main[2497]:address of pattern vault.prelude missing >

[Monetdb-developers] MonetDB deadlocks on clients, now what?

2010-10-19 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Lately MonetDB starts to deadlock on the clients. Bugs were reported, typically I have connected ~8 clients connected at the same time. http://bugs.monetdb.org/show_bug.cgi?id=2670 Do other people observe this? Is there a good way to debug where i

Re: [Monetdb-developers] write error

2010-10-07 Thread Stefan de Konink
On Thu, 7 Oct 2010, Mark Bucciarelli wrote: > I'm getting a "write error" when running a fairly large > and complex query (five tables and subselect in where). Is it possible that your shell is a non-utf8 thing, and you are printing utf8? Stefan ---

Re: [Monetdb-developers] How to enable functions via sql?

2010-09-23 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 23-09-10 20:54, Alexandr Kulik schreef: > I implement few functions (standard deviation sample and population, > variance sample ad population). Is it possible to commit them into > MonetDB repo? Again, use the monetdb-dev list. I guess your be

Re: [Monetdb-developers] How to enable functions via sql?

2010-09-20 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 20-09-10 19:57, Alexandr Kulik schreef: > I find how could i do it. Now i fighting with another problem. Is it > possible from monetdb sql side create aggregation function that will > receive 2 arguments? Probably e-mailing the monetdb-dev list i

Re: [Monetdb-developers] How to enable functions via sql?

2010-09-06 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 06-09-10 18:13, Alexandr Kulik schreef: > I need to develop some extra statistical functions for MonetDB. I > spent about a week to understand how to use function via sql, but > still didn't have any succes results. May be someone could point me t

Re: [Monetdb-developers] About monetdb's thread

2010-07-29 Thread Stefan de Konink
On Thu, 29 Jul 2010, Stefan Manegold wrote: > we do not know of a simple way (e.g., system call) to find out the number of > CPU cores on a Windows system, hence, we set the default number of threads > in the MonetDB kernel to 1. http://stackoverflow.com/questions/150355/programmatically-find-the

Re: [Monetdb-developers] about import *.csv

2010-07-11 Thread Stefan de Konink
On Mon, 12 Jul 2010, kun ren wrote: > I am new to Monetdb, I want to ask how to excute the statement mclient -lsql >> if i want to import many *.csv,such as a.csv,b.csv but i only have >> *.csv file,and don't know the type of every column,in order to universal, i >> want to write a progrom,

Re: [Monetdb-developers] about import *.csv

2010-07-11 Thread Stefan de Konink
On Mon, 12 Jul 2010, kun ren wrote: Dear all, I want to import *.csv into MonetDB,what interface do i will use?? Just mclient, create your table. And use copy into so for example copy i<> records into <> from 'filename' delimiters ',', '\n', null as ''; Stefan--

Re: [Monetdb-developers] MonetDB memory management

2010-04-15 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 15-04-10 06:06, Xiao Lei schreef: > And when i insert again, memory used keeps increasing. > > Is this a problem or is it the way MonetDB works? I can confirm this behavior. Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.14 (GNU/Lin

Re: [Monetdb-developers] help regarding installtion after changes

2010-04-10 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 10-04-10 21:20, anshul gangwar schreef: > hello >If the installation fails , how to remove the changes that > installation has done. > > We are doing the changes to file gdk_relop.c and its .mx one and then > using super > tar ball we are try

Re: [Monetdb-developers] the database and index size

2010-03-30 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 30-03-10 22:37, Mo Zhou schreef: > When I create a database and load the data from plain files, does > monetdb create indexes automatically? Correct! It will only create indices and maintain them when it is useful. > When I examine the disk usag

Re: [Monetdb-developers] BAT_select description

2010-03-22 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 22-03-10 18:55, anshul gangwar schreef: > hello > Where can i find the description of BAT_select? http://monetdb.cvs.sourceforge.net/viewvc/monetdb/MonetDB/src/gdk/gdk.mx?view=markup Line: 3425 Stefan -BEGIN PGP SIGNATURE- Vers

Re: [Monetdb-developers] Fw: Re: Fw: Re: related to jdbc

2010-03-14 Thread Stefan de Konink
sword you can use this one: stethoscope -umonetdb -Pmonetdb +tis algebra.* bat.* group.* sql.* aggr.* Please report back how useful this was for your debuging and use of MonetDB. We appreciate your interest. Yours Sincerely, Stefan de Konink -BEGIN PGP SIGNATURE- Version: GnuPG v

Re: [Monetdb-developers] related to jdbc

2010-03-14 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 14-03-10 18:23, anshul gangwar schreef: > Can we get the debugger output through jdbc You can enable the ODBC debug output by your ODBC configuration. For example: Trace = Yes TraceFile = /tmp/debug.log ForceTrace = Yes Stefan -BEGIN

Re: [Monetdb-developers] Single column select vs aggregation

2010-02-18 Thread Stefan de Konink
Op 18-02-10 19:44, Stefan Manegold schreef: > because it is built on an intermediate result (base BAT plus delta BATs > applied) that is gone, again after the query has been executed. I really feel I have learnt something now :) thanks :) Given this information, is there a way to get the cost fun

Re: [Monetdb-developers] Single column select vs aggregation

2010-02-18 Thread Stefan de Konink
Op 18-02-10 19:22, Stefan Manegold schreef: > "It" (in fact we) choose to do a hash select, and since there is no hash > table, yet, we need to build it, which is infact more expensive than a > simple scan select for this very operation (later operation *might* then > benefit from the hash table ..

Re: [Monetdb-developers] Single column select vs aggregation

2010-02-18 Thread Stefan de Konink
Op 18-02-10 18:23, Stefan Manegold schreef: > On Thu, Feb 18, 2010 at 05:46:31PM +0100, Stefan de Konink wrote: >> Attached is a trace of a single column select operation, with a max, >> avg and equality. >> >> The equality takes about 4 times more time than the avg oper

[Monetdb-developers] Single column select vs aggregation

2010-02-18 Thread Stefan de Konink
Attached is a trace of a single column select operation, with a max, avg and equality. The equality takes about 4 times more time than the avg operation. From the plan I see that the operation is executed paralel, but I do wonder why suddenly the uselect takes such a high amount of time. St

[Monetdb-developers] Maximum length of /any/ entry

2010-02-16 Thread Stefan de Konink
Hi, Is the maximum length of a str (intmax) equal to maximum length of any other object we can currently store? Stefan -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Heali

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/mapiclient MapiClient.mx, , 1.194, 1.195

2010-02-12 Thread Stefan de Konink
Op 12-02-10 18:01, Fabian Groffen schreef: > On 12-02-2010 16:37:28 +0000, Stefan de Konink wrote: >> Update of /cvsroot/monetdb/clients/src/mapiclient >> In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv3 >> >> Modified Files: >> MapiClient.

Re: [Monetdb-developers] @= atomtostr memory usage

2010-02-11 Thread Stefan de Konink
On Thu, 11 Feb 2010, Martin Kersten wrote: > Refrain from checking in this patch. Can the part that uses the output of snprintf instead of strlen be used? Your comment regarding memory fragmentation is ofcourse valid in a sense there will be fragmentation since there is allocated too much memory

[Monetdb-developers] @= atomtostr memory usage

2010-02-10 Thread Stefan de Konink
Hi, While creating some new code and seeing unexpected, but interesting, behavior I stumbled upon the @= atomtostr code, some simple questions regarding this. It seems that the memory requested in @= atommem is rather pessimistic. It seems that for a regular integer 24 characters are allocated.

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server rel_schema.mx, Feb2010, 1.2, 1.2.2.1

2010-02-05 Thread Stefan de Konink
Op 05-02-10 11:32, Wouter Alink schreef: > fantastisch! 1. fantastisch [a] (great) remarkable or out of the ordinary in degree or magnitude or effect. -- The Planet: dedicated and managed hosting, cloud storage, colocati

Re: [Monetdb-developers] How to not print on screen?

2010-01-28 Thread Stefan de Konink
Op 28-01-10 17:36, Mo Zhou schreef: > I wonder if there is a way to not print query results on screen but > print the timer? I thought recently the timer code went to stderr, while the query results went into stdout. In that case: mclient 1>/dev/null 2>yourfile Would get you the result in

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk.mx, , 1.294, 1.295 gdk_atoms.mx, , 1.168, 1.169 gdk_bbp.mx, , 1.267, 1.268 gdk_heap.mx, , 1.129, 1.130 gdk_search.mx, , 1.89, 1.90

2010-01-05 Thread Stefan de Konink
Op 05-01-10 20:54, Sjoerd Mullender schreef: > There is also code in there to store the string length before the hash > value, but this is not enabled in this version. It would increase the > space requirements for probably very little (if any) gain. As in the feature request was suggested, the s

Re: [Monetdb-developers] Think someone forgot something again...

2009-09-04 Thread Stefan de Konink
Op 4 sep 2009 om 08:51 heeft Fabian Groffen het volgende geschreven:\ > On 04-09-2009 00:47:48 +0200, Stefan de Konink wrote: >> -BEGIN PGP SIGNED MESSAGE- >> Hash: SHA512 >> >> !SyntaxException:slave.close[0]:RETURN missing > > can you describe what

[Monetdb-developers] New login intentional?

2009-09-03 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 It seems to be that there is a new mechanism that basically doesn't allow mclient to connect directly anymore. Is this behavior intentional? The workaround seems to be -umonetdb with monetdb as password. Stefan -BEGIN PGP SIGNATURE- Versio

[Monetdb-developers] Think someone forgot something again...

2009-09-03 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 !SyntaxException:slave.close[0]:RETURN missing Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEAREKAAYFAkqgR5MACgkQYH1+F2Rqwn2RSQCeKz0nIOwSoT51GTAA3w6nWHz1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal replicator.mx, , 1.14, 1.15

2009-08-29 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 ../../../../src/modules/mal/replicator.mx: In function ‘MASTERreplay’: ../../../../src/modules/mal/replicator.mx:551: error: ‘msg’ may be used uninitialized in this function make[8]: *** [lib_replicator_la-replicator.lo] Error 1 I get the following

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_joinpath.mx, Aug2009, 1.50, 1.50.2.1

2009-08-16 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Martin Kersten schreef: > For key-valued columns the max join result size is known. > /* foreign key joins are common */ > if( l->ttype== TYPE_oid || r->htype == TYPE_oid || r->htype== > TYPE_void) > return MAX(lc,rc); >

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/examples/C sample0.c, Aug2009, 1.9, 1.9.2.1 sample1.c, Aug2009, 1.9, 1.9.2.1 sample2.c, Aug2009, 1.9, 1.9.2.1 sample3.c, Aug2009, 1.11, 1.11.2.1

2009-08-13 Thread Stefan de Konink
On Thu, 13 Aug 2009, Sjoerd Mullender wrote: > Stefan de Konink wrote: > > Could this also be fixed with the same construction? > > Could what be fixed? > >> #ifdef _MSC_VER > >> #define snprintf _snprintf > >> +#define LLFMT "%I64d" > &

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/examples/C sample0.c, Aug2009, 1.9, 1.9.2.1 sample1.c, Aug2009, 1.9, 1.9.2.1 sample2.c, Aug2009, 1.9, 1.9.2.1 sample3.c, Aug2009, 1.11, 1.11.2.1

2009-08-13 Thread Stefan de Konink
Could this also be fixed with the same construction? Stefan On Thu, 13 Aug 2009, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/clients/src/examples/C > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv30784/src/examples/C > > Modified Files: > Tag: Aug2009 > sample0.c sam

Re: [Monetdb-developers] GooglePerformanceTools with MonetDB?

2009-08-04 Thread Stefan de Konink
On Tue, 4 Aug 2009, Martin Kersten wrote: > Chunk based (m)allocation of structures was part of MonetDB version 1. Were direct systemcalls used? Or is glibc still used? Stefan -- Let Crystal Reports handle the reporti

Re: [Monetdb-developers] GooglePerformanceTools with MonetDB?

2009-08-04 Thread Stefan de Konink
On Tue, 4 Aug 2009, Fabian Groffen wrote: > from a previous life I recall that it was said to be boosting MySQL, but > actually setting it up wasn't as trivial as it seemed Someone asked if I could do a comparison on my favorite webserver; If it is as trivial as it looks, I'll see if I can come u

[Monetdb-developers] GooglePerformanceTools with MonetDB?

2009-08-04 Thread Stefan de Konink
GooglePerformanceTools gives an alternative (threaded) implementation of malloc under a BSD License. Has it even been tested with MonetDB before? http://code.google.com/p/google-perftools/wiki/GooglePerformanceTools I mean, it looks very simple to use and test :) And implements the ideas I have

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal pcre.mx, , 1.86, 1.87

2009-08-02 Thread Stefan de Konink
Op 2 aug 2009 om 01:01 heeft Stefan Manegold het volgende geschreven:\ > On Sat, Aug 01, 2009 at 07:13:18PM +0200, Stefan de Konink wrote: >> On Sat, 1 Aug 2009, Stefan Manegold wrote: >> >>> Once / in case that turns[C out to be(come) a performance >>> bott

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal pcre.mx, , 1.86, 1.87

2009-08-01 Thread Stefan de Konink
On Sat, 1 Aug 2009, Stefan Manegold wrote: > Once / in case that turns[C out to be(come) a performance bottleneck, we could > probably add a BAT(u)iselect (for string-tailed BATs, only) that is based on > strcasecmp(3) with not too much efford ... Is that UTF8 compatible? Stefan -

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server rel_select.mx, May2009, 1.143.2.4, 1.143.2.5

2009-07-30 Thread Stefan de Konink
On Fri, 31 Jul 2009, Niels Nes wrote: Here you still asign something that could be NULL. > dnode *n = selection->h; > > - (void) where; > + if (!selection) > + return sql_error(sql, 02, "SELECT: the selection or from part > is missing"); So the asignment should be afte

Re: [Monetdb-developers] Connection fails

2009-07-27 Thread Stefan de Konink
On Mon, 27 Jul 2009, Riham Abdel Kader wrote: > Any idea what I could be doing wrong? You are using IPv6 :) try 127.0.0.1. Stefan -- ___ Monetdb-developers mailing list Mone

Re: [Monetdb-developers] Connection string for ODBC

2009-07-14 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Chebbi, Pavan wrote: > Could anybody give me a connection string to use with ODBC DSN ? My odbc.ini [MondrianFoodMart] Description = Test Driver = MonetDB Database = demo Servername = localhost Username = monetdb Password = monetdb Port = 5 Re

Re: [Monetdb-developers] Python breaks clients?

2009-07-03 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Sjoerd Mullender wrote: > On 2009-07-02 23:31, Stefan de Konink wrote: >> make[9]: *** No rule to make target `mapi25.py', needed by >> `install-exec-local-mapi25.py'. Stop. >> >> >> Does anyone have th

[Monetdb-developers] Python breaks clients?

2009-07-02 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 make[9]: *** No rule to make target `mapi25.py', needed by `install-exec-local-mapi25.py'. Stop. Does anyone have this currently? I do have python2.6 installed. Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.12 (GNU/Linux) Comment: Usi

Re: [Monetdb-developers] Mapilib example

2009-06-12 Thread Stefan de Konink
Fabian Groffen wrote: > Hence, please review the attached diff and comment before I > commit this. I like your changes; not compiled yet though. From my first interaction with MAPI it would also been nice if a program could touch all functions with some basic inline commenting style. Because I

Re: [Monetdb-developers] ODBC windows build script

2009-05-22 Thread Stefan de Konink
Stefan Manegold wrote: > On Fri, May 22, 2009 at 11:30:26PM +0200, Stefan de Konink wrote: >> Is there any 'asset' available that allows to build the Windows ODBC >> driver from within Linux > > not "out-of-the-box" AFAIK --- but cross-compilation (given

[Monetdb-developers] ODBC windows build script

2009-05-22 Thread Stefan de Konink
Is there any 'asset' available that allows to build the Windows ODBC driver from within Linux or a howto to build it in Windows? Especially related to the recent authentication changes. Stefan -- Register Now for Creat

[Monetdb-developers] DBSlayer for MonetDB

2009-05-21 Thread Stefan de Konink
Hi, I have set up a development server for OpenStreetMap that allows 'Joe Regular' to perform /any/ SQL request on a dataset limited to the borders of The Netherlands, Belgium and Luxembourgh. That means around 700MB of data. Because OpenStreetMap mainly targets webdevelopment, making it e

Re: [Monetdb-developers] OpenSSL header check

2009-05-20 Thread Stefan de Konink
Fabian Groffen wrote: > ... and did you try after Stefan's fixes which cover up for my mistakes? Aah ;) I didn't check my Checkins folder ;) Now get your point ;) Will give it a shot. Stefan -- Crystal Reports - New Fre

Re: [Monetdb-developers] OpenSSL header check

2009-05-20 Thread Stefan de Konink
Fabian Groffen wrote: > On 20-05-2009 09:43:06 +0200, Fabian Groffen wrote: >> On 20-05-2009 00:53:23 +0200, Stefan de Konink wrote: >>> I was just compiling MonetDB head on this distro called `Debian' (poor >>> me). In the middle of the compilation I had miss

[Monetdb-developers] OpenSSL header check

2009-05-19 Thread Stefan de Konink
I was just compiling MonetDB head on this distro called `Debian' (poor me). In the middle of the compilation I had missing headers. Wouldn't it be feasible to check for them like we check for PCRE presence? Stefan -- C

Re: [Monetdb-developers] Performance of COPY INTO: data source & constraint checking

2009-05-18 Thread Stefan de Konink
On Mon, 18 May 2009, Stefan Manegold wrote: > In case you came to your conclusion from experimental/emperical study, I > would be very interested to know about the experiemntes performed and the > results measured. > In that case, I would be verythankful if you could share the informative > detail

Re: [Monetdb-developers] Suggestion to ditch SHA-1, and embrace SHA-2

2009-05-17 Thread Stefan de Konink
Roberto Cornacchia wrote: > 2. The restore is almost unusable for large databases, as it is > extremely slow. I suspect the main reasons being: > - COPY INTO .. FROM STDIN (used in the dump) is much much slower than > copying from a file, regardless of whether the number or record to copy > is give

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5 sql_user.mx, , 1.42, 1.43

2009-05-10 Thread Stefan de Konink
Fabian wrote: > int len = strlen(passwd); > - if ((ret = AUTHSHA1Sum(&pwd, &passwd, &len)) != MAL_SUCCEED) { > + if ((ret = AUTHBackendSum(&pwd, &passwd, &len)) != MAL_SUCCEED) > { A sum of 0 will not work. Stefan --

Re: [Monetdb-developers] Some mdumpsql change

2009-05-10 Thread Stefan de Konink
Fabian Groffen wrote: > On 10-05-2009 15:09:20 +0200, Stefan de Konink wrote: >> Fabian Groffen wrote: >>> On 10-05-2009 14:52:14 +0200, Stefan de Konink wrote: >>>> Stefan de Konink wrote: >>>>> I am looking at this now I agree with you that this co

Re: [Monetdb-developers] Some mdumpsql change

2009-05-10 Thread Stefan de Konink
Fabian Groffen wrote: > On 10-05-2009 14:52:14 +0200, Stefan de Konink wrote: >> Stefan de Konink wrote: >>> I am looking at this now I agree with you that this could help a lot. >>> Will need to move some stuff around because of the -D option that (imho) >>

Re: [Monetdb-developers] Suggestion to ditch SHA-1, and embrace SHA-2

2009-05-10 Thread Stefan de Konink
Stefan de Konink wrote: I am looking at this now I agree with you that this could help a lot. Will need to move some stuff around because of the -D option that (imho) should inline everything. As attached. Ok to commit? If so could anyone help with approving tests? Stefan Index: dump.c

Re: [Monetdb-developers] Suggestion to ditch SHA-1, and embrace SHA-2

2009-05-10 Thread Stefan de Konink
Roberto Cornacchia wrote: > 2. The restore is almost unusable for large databases, as it is > extremely slow. I suspect the main reasons being: > - COPY INTO .. FROM STDIN (used in the dump) is much much slower than > copying from a file, regardless of whether the number or record to copy > is give

Re: [Monetdb-developers] Suggestion to ditch SHA-1, and embrace SHA-2

2009-05-09 Thread Stefan de Konink
Fabian Groffen wrote: > On 08-05-2009 19:54:38 +0200, Stefan de Konink wrote: >> As already found in the news SHA-1 is advised to migrated off by 2010. I >> would suggest SHA-2 in protocol 9. > > Which one of the SHA-2 family then? And is it really that important > given

[Monetdb-developers] Suggestion to ditch SHA-1, and embrace SHA-2

2009-05-08 Thread Stefan de Konink
As already found in the news SHA-1 is advised to migrated off by 2010. I would suggest SHA-2 in protocol 9. Stefan -- The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your production scanning environm

Re: [Monetdb-developers] Victory! iDatabase!

2009-05-03 Thread Stefan de Konink
Stefan de Konink wrote: > Everything worked out of the box; except for the minor > detail 'application signing'. For some reason the default permissions do > not like mserver5 at all, the binary is Killed as if it was not signed > at all. I have yet to find out why

[Monetdb-developers] Victory! iDatabase!

2009-05-03 Thread Stefan de Konink
iPod-van-Stefan-de-Konink:/Applications/MonetDB.app/bin root# ./mserver5 --dbinit="include sql;" # MonetDB server v5.11.0, based on kernel v1.29.0 # Serving database 'demo', using 1 thread # Compiled for arm-apple-darwin9/32bit with 32bit OIDs dynamically linked # Copyright (c

Re: [Monetdb-developers] MonetDB on Darwin/ARM

2009-05-03 Thread Stefan de Konink
Fabian Groffen wrote: > MonetDB doesn't compile gdk_scanselect on my FreeBSD Xen instance due > its requirements, (>2.5GB of (virtual) memory), the only package I've > encountered so far with such requirements. I still wonder how TCC would do it ;) Stefan ---

Re: [Monetdb-developers] MonetDB on Darwin/ARM

2009-05-03 Thread Stefan de Konink
Hi Fabian, Fabian Groffen wrote: > On 03-05-2009 06:48:53 +0200, Stefan de Konink wrote: >> #WARNING: LoaderException:loadLibrary:mmath: loader error >> dlopen(/Applications/MonetDB.app/lib/MonetDB5/lib/lib_mmath.dylib, 10): >> Symbol not found: ___fpclassifyd

[Monetdb-developers] MonetDB on Darwin/ARM

2009-05-02 Thread Stefan de Konink
With a bit of hacking in the C compiler, and doing a variety of --enable-shared vs --disabled-shared I am able to come up to this point: iPod-van-Stefan-de-Konink:/Applications/MonetDB.app/bin root# ./mserver5 !ERROR: BBPdiskscan: stat(bat/)!OS: No such file or directory !ERROR: BBPdiskscan

Re: [Monetdb-developers] New oid32 system; bulk rotate error

2009-04-18 Thread Stefan de Konink
Stefan de Konink wrote: > sql>ALTER TABLE relation_members_node ADD CONSTRAINT > pk_relation_members_node PRIMARY KEY (relation, idx); > 0 tuples > !MALException:mkey.bulk_rotate_xor_hash:command failed > > > Within a transaction I get the previous error. My dataset on d

[Monetdb-developers] New oid32 system; bulk rotate error

2009-04-16 Thread Stefan de Konink
sql>ALTER TABLE relation_members_node ADD CONSTRAINT pk_relation_members_node PRIMARY KEY (relation, idx); 0 tuples !MALException:mkey.bulk_rotate_xor_hash:command failed Within a transaction I get the previous error. My dataset on disk is now 29GB after switching to oid32 on a 64bit system, 64

Re: [Monetdb-developers] Another big group by query

2009-04-13 Thread Stefan de Konink
Stefan Manegold wrote: > On Mon, Apr 13, 2009 at 02:30:44AM +0200, Stefan de Konink wrote: >> Martin Kersten wrote: >>> You can trace the execution even for a server started already using >>> the stethoscope. > > What does this/you you want to tell/show us? >

Re: [Monetdb-developers] Another big group by query

2009-04-12 Thread Stefan de Konink
Martin Kersten wrote: > You can trace the execution even for a server started already using > the stethoscope. p[ 605303, mt, # name [ 51,"_30 := bat.mirror(ext35=[362105182]);" ] [ 1282955, "grp20 := nil;"] [ 13, 955, "grp20 := nil;" ] [ 13,"ext35 := nil;" ] [ 1038065

Re: [Monetdb-developers] Another big group by query

2009-04-12 Thread Stefan de Konink
Stefan Manegold wrote: > load is 1.0 --- i.e., one thrad full throttle --- unless it is a "fake" load > due to a Dead/Dummy/zombie process that is (e.g.) waiting for I/O --- in > top, type "1" to get the summaries for all cores and "H" to list all threads > and "u"+[Enter] to list processes of all

[Monetdb-developers] Another big group by query

2009-04-11 Thread Stefan de Konink
Hi All, Might be better to go by the mailinglist instead of adding many people to the CC. Currently I am running the latest CVS code disabled mitosis and am running the following code: CREATE TABLE "sys"."way_nds" ( "way" int NOT NULL, "idx" int NOT NULL, "to_node" i

[Monetdb-developers] do_not_use_posix_fadvise

2009-03-23 Thread Stefan de Konink
Hi, What is the rationale to enable or disable fadvise explicitly? do_not_use_posix_fadvise = uname(&ubuf) == 0 && strcmp(ubuf.sysname, "Linux") == 0 && strncmp(ubuf.release, "2.4", 3) <= 0; Answers as "it doesn't work" will not satisfy my hunger to this answer; because I do see a completely

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5 sql.mx, , 1.321, 1.322 sql_scenario.mx, , 1.337, 1.338

2009-03-07 Thread Stefan de Konink
Fabian Groffen wrote: > On 07-03-2009 23:09:13 +0100, Stefan de Konink wrote: >>>> The code was added to have last_id support within the ODBC interface; >>>> required for phpBB compatibility. >>> Weird, ODBC already knows it, and more reliable, via the respo

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5 sql.mx, , 1.321, 1.322 sql_scenario.mx, , 1.337, 1.338

2009-03-07 Thread Stefan de Konink
Fabian Groffen wrote: > On 07-03-2009 21:41:21 +0000, Stefan de Konink wrote: >> This code adds the last_id variable to MonetDB5/SQL to implement 'in SQL' >> access to the last updated sequence, in a similar fashion as the @@IDENTITY >> found in MSSQL. For future

[Monetdb-developers] Aggr function comment clarification

2009-02-06 Thread Stefan de Konink
Could anyone elaborate what: comment "Sum over grouped tail sum on @1"; vs comment "Grouped tail sum on @1"; ...means? It is the distinct difference between AX3aggrX3_sum and AX3aggrX3_sum3. I'm looking for this `answer' just from an informational perspective. Stefan -

[Monetdb-developers] char *mapi_get_type(MapiHdl hdl, int fnr)

2009-01-24 Thread Stefan de Konink
What is the reason that $subj is not a const char *? Stefan -- This SF.net email is sponsored by: SourcForge Community SourceForge wants to tell your story. http://p.sf.net/sfu/sf-spreadtheword __

Re: [Monetdb-developers] mclient running out of memory, crashing mserver5

2009-01-20 Thread Stefan de Konink
sylver_b wrote: > I don't think i'm running out of memory. I had to stop and restart > mserver5, flush the table, then re-run the command - all the records > were inserted. Also I noticed this type of messages on the mserver5 > console when piping records through the mclient (over 1million recor

[Monetdb-developers] !MALException:mkey.bulk_rotate_xor_hash:command failed

2008-12-14 Thread Stefan de Konink
sql>ALTER table way_tags add primary key(way, k); !MALException:mkey.bulk_rotate_xor_hash:command failed What should I read from that one? Stefan -- SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, N

[Monetdb-developers] # falling back to direct mode

2008-12-14 Thread Stefan de Konink
As $subj; What does it mean? I'm about to run my final result test on the new algebra version; but I just wondered what it means. Stefan -- SF.Net email is Sponsored by MIX09, March 18-20, 2009 in Las Vegas, Nevada. T

Re: [Monetdb-developers] gridsql

2008-12-09 Thread Stefan de Konink
[EMAIL PROTECTED] wrote: > Can you have a 1-2 hour look at gridsql if it is feasible at all. > If so, let's push Venks ;) > otherwise avoid the frustration for him. Here you mean to be able to use a MAPI driver? Stefan

Re: [Monetdb-developers] Could not create hash table for key test

2008-11-23 Thread Stefan de Konink
Martin Kersten wrote: > For large table loads (relative to the swap size) it is advisable to > load in multiple steps. > First load the data into the tables without (foreign) key checks. > After this step ALTER the tables to respect the (foreign) keys. I don't know if it was the swap space or th

Re: [Monetdb-developers] Monetdb-developers Digest, Vol 30, Issue 10

2008-11-23 Thread Stefan de Konink
Peter Boncz wrote: > With hindsight, this API decision was bad judgement; because the question > whether real file mapping is used now depends on the question whether the > filename was initialized at BAT or Hash table creation. Now, this should be > the case, but it would be my first question to a

Re: [Monetdb-developers] Constraint violations with all details

2008-11-23 Thread Stefan de Konink
Romulo Goncalves wrote: > Something like this might work... > > Select to_way from relation_members_way where to_way not in (select > to_way from ways); Wow :) Yup that works with a slight modification too :) Select distinct relation from relation_members_way where to_way not in (select id from

[Monetdb-developers] Constraint violations with all details

2008-11-23 Thread Stefan de Konink
Hi, I cannot find it back in the trackers but I think it have asked this question before. Would it be possible to output the actual failing constraint details instead of 'just an error'. sql>alter table relation_members_way add constraint relation_to_way_fkey foreign key(to_way) references w

Re: [Monetdb-developers] Could not create hash table for key test

2008-11-23 Thread Stefan de Konink
Hi Peter, Peter Boncz wrote: > Like Martin indicated, MonetDB runs out of memory here, when trying to obtain > a contiguous area of 14GB. But is a contiguous area of 14GB required for this? That is much memory! > The error messages show that MonetDB is pulling all the stops to try to get > this

Re: [Monetdb-developers] Could not create hash table for key test

2008-11-23 Thread Stefan de Konink
Martin Kersten wrote: > For large table loads (relative to the swap size) it is advisable to > load in multiple steps. > First load the data into the tables without (foreign) key checks. > After this step ALTER the tables to respect the (foreign) keys. Sadly the 49GB table will also not insert wi

Re: [Monetdb-developers] Could not create hash table for key test

2008-11-23 Thread Stefan de Konink
On Sun, 23 Nov 2008, Stefan Manegold wrote: > From the trace above, I comclude that MonetDB is unable to allocate a 14GB > chunk --- first (obvious) questions to ask and answer: > Is your CoreDuo (or Core2Duo?) a 64-bit CPU? 64bit kernel/userland. I don't think it is actually both, it is one of t

Re: [Monetdb-developers] Could not create hash table for key test

2008-11-23 Thread Stefan de Konink
On Sun, 23 Nov 2008, Martin Kersten wrote: > Stefan de Konink wrote: > > #BBPTRIM_ENTER: memsize=180224,vmsize=14397997056 > > #BBPTRIM: memtarget=0 vmtarget=0 > > #BBPTRIM_EXIT: memsize=20365312,vmsize=14397997056 > > #BBPTRIM_ENTER: memsize=2496368440,vmsize=16874000

Re: [Monetdb-developers] Could not create hash table for key test

2008-11-23 Thread Stefan de Konink
On Sun, 23 Nov 2008, Martin Kersten wrote: > The system is trying to malloc space for (in this case) a hash table, > but that instruction fails. Then it attempts to free up memory by > swapping out tables. > Given the fact that after this sweep it still fails, indicates that > your swap memory ha

Re: [Monetdb-developers] Could not create hash table for key test

2008-11-22 Thread Stefan de Konink
#BBPTRIM_ENTER: memsize=180224,vmsize=14397997056 #BBPTRIM: memtarget=0 vmtarget=0 #BBPTRIM_EXIT: memsize=20365312,vmsize=14397997056 #BBPTRIM_ENTER: memsize=2496368440,vmsize=16874000184 #BBPTRIM: memtarget=778092856 vmtarget=0 #BBPTRIM_EXIT: memsize=20365312,vmsize=10150287928 Killed This one al

[Monetdb-developers] Could not create hash table for key test

2008-11-22 Thread Stefan de Konink
#GDKmalloc(14777222432) fail => BBPtrim(enter) usage[mem=14840896,vm=27527806976] #BBPTRIM_ENTER: memsize=14840896,vmsize=27527806976 #BBPTRIM: memtarget=4611686018427387904 vmtarget=0 #BBPTRIM_EXIT: memsize=19120128,vmsize=27527806976 #GDKmalloc(14777222432) fail => BBPtrim(ready) usage[mem=11

  1   2   >