Bugs item #2808353, was opened at 2009-06-18 14:48
Message generated for change (Comment added) made by stmane
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2808353&group_id=56967

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: SQL/Core
Group: SQL CVS Head
Status: Open
Resolution: None
Priority: 3
Private: Yes
Submitted By: Stefan de Konink (skinkie)
Assigned to: Niels Nes (nielsnes)
>Summary: SQL: not (...) goes far out of hand

Initial Comment:
To create the table; /export refers to loki.

create table kvk (kvk bigint, bedrijfsnaam varchar(255), adres varchar(64), 
postcode varchar(6), plaats varchar(32), type varchar(16));
create table anbikvk (naam varchar(256), vestigingsplaats varchar(32), besch
ikking date, intrekking date, kvk bigint);
create table anbi (naam varchar(256), vestigingsplaats varchar(32), beschikk
ing timestamp, intrekking timestamp);
COPY 27598 RECORDS INTO anbi FROM '/export/scratch1/konink/anbi.csv' USING 
DELIMITERS ',', '\n', '""';
COPY 1621594 RECORDS INTO kvk FROM '/export/scratch1/konink/allesn' USING 
DELIMITERS ',', '\n', '""';
insert into anbikvk select naam, vestigingsplaats, beschikking, intrekking, 
kvk from kvk,anbi where lower(naam) = lower(bedrijfsnaam) and lower(plaats) = lo
wer(vestigingsplaats);
select count(*) from kvk,anbi where not (lower(naam) = lower(bedrijfsnaam) and 
lower(plaats) = lowers(vestigingsplaats));

Known errors are:
- Segmentation fault (64/32)
- BUN error
- !ERROR: GDKsave: error on: name=54/5412, ext=head, mode=1
  !OS: No space left on device
 !ERROR: GDKload: failed name=54/5412, ext=head

The database is by far smaller than main memory.

----------------------------------------------------------------------

>Comment By: Stefan Manegold (stmane)
Date: 2009-08-14 13:58

Message:
tagged subject

----------------------------------------------------------------------

Comment By: Stefan de Konink (skinkie)
Date: 2009-08-11 02:30

Message:
Points:
1) Can lower = lower (or upper = upper) be recognized in the parser as
case insensitive comparison? Instead of transforming two entire columns to
another value.

Plan:
#project (
#| group by (
#| | select (
#| | | crossproduct (
#| | | | table(sys.kvk) [ kvk.bedrijfsnaam, kvk.plaats, kvk.%TID% NOT NULL
],
#| | | | table(sys.anbi) [ anbi.naam, anbi.vestigingsplaats, anbi.%TID%
NOT NULL ]
#| | | )
#| | ) [ not(and(=(lower(anbi.naam), lower(kvk.bedrijfsnaam)),
=(lower(kvk.plaats), lower(anbi.vestigingsplaats)))) = true ]
#| ) [  ] [ count NOT NULL as L1 ]
#) [ L1 NOT NULL ]

Trace (doesn't run on a full database) as will be attached.

----------------------------------------------------------------------

Comment By: Martin Kersten (mlkersten)
Date: 2009-08-06 16:03

Message:
To be further investigated when the minimal database + testscript is
provided.
Alternatively, a TRACE of this query against the original might provide
the information needed.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2808353&group_id=56967

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
Monetdb-bugs mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/monetdb-bugs

Reply via email to