Bugs item #2071638, was opened at 2008-08-24 16:44
Message generated for change (Comment added) made by stmane
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2071638&group_id=56967

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: Mapi
Group: XML
>Status: Closed
Resolution: Works For Me
Priority: 5
Private: No
Submitted By: Stefan de Konink (skinkie)
Assigned to: Stefan Manegold (stmane)
Summary: mclient output is limited?

Initial Comment:
/opt/monetdb/bin/mclient -lxquery
xquery>count(doc("planet-nl.osm")/osm/node)
more>5689472

/opt/monetdb/bin/mclient -lxquery < osm-all-sql-node.xq > node.sql

for $node in doc("planet-nl.osm")/osm/node
return
element { "n" }
{
                data($node/@id),
                text { ", " },
                data($node/@lat),
                text { ", " },
                data($node/@lon),
                text { ", '" },
                data($node/@user),
                text { "', '" },
                data($node/@timestamp),
                text { "'" }
}

[EMAIL PROTECTED] ~ $ wc node.sql 
  4478  22596 321310 node.sql


Maybe the just reported feature is a solution to this bug.

----------------------------------------------------------------------

>Comment By: Stefan Manegold (stmane)
Date: 2008-09-25 11:03

Message:
Stefan,

I assuming it also work for you, now;
feel free to re-open if not ...

Stefan


----------------------------------------------------------------------

Comment By: Stefan Manegold (stmane)
Date: 2008-09-05 11:22

Message:
Logged In: YES 
user_id=572415
Originator: NO

Stefan,

any news on this one?
did you manage to test it, again?
does it work for you, too?
can we close this report?

Thanks!
Stefan


----------------------------------------------------------------------

Comment By: Stefan Manegold (stmane)
Date: 2008-08-26 08:45

Message:
Logged In: YES 
user_id=572415
Originator: NO

Finally:
For me, it also works fine with the old MPS back-end for all 4 cases
(Stable & Current each with read-only and updateable).

ps:
My setup:
64-bit machine with 8GB RAM;
running 64-bit Fedora 8;
64-bit MonetDB/XQuery (with default 64-bit OIDs);
configured with --disable-debug --enable-optimize --disable-assert;
compiled with gcc 4.1.2 .


----------------------------------------------------------------------

Comment By: Stefan de Konink (skinkie)
Date: 2008-08-25 22:17

Message:
Logged In: YES 
user_id=533026
Originator: YES

I'll test it this weekend.

----------------------------------------------------------------------

Comment By: Stefan Manegold (stmane)
Date: 2008-08-25 20:22

Message:
Logged In: YES 
user_id=572415
Originator: NO

Also works with the latest version from most recent release branches (cf.,
http://monetdb.cwi.nl/Development/Releases/Version4.24/).


----------------------------------------------------------------------

Comment By: Stefan Manegold (stmane)
Date: 2008-08-25 17:36

Message:
Logged In: YES 
user_id=572415
Originator: NO

With the latest CVS HEAD version of MonetDB/XQuery, your query appears to
work fine with me, both with a read-only document and with an updateable
document with 10% slack space:

$ mclient -lx
-s'pf:add-doc("/tmp/planet-nl-080823.osm","planet-nl.osm.RO")'
$ mclient -lx -s'count(doc("planet-nl.osm.RO")/osm/node)' | tee
/tmp/planet-nl.osm.RO.count
5689472
$ mclient -lx /tmp/planet-nl.osm.bug.RO.xq >
/tmp/planet-nl.osm.bug.RO.out
$ wc /tmp/planet-nl.osm.bug.RO.out
  5689472  28725882 399286712 /tmp/planet-nl.osm.bug.RO.out

$ mclient -lx
-s'pf:add-doc("/tmp/planet-nl-080823.osm","planet-nl.osm.10","planet-nl.osm.10",10)'
$ mclient -lx -s'count(doc("planet-nl.osm.10")/osm/node)' | tee
/tmp/planet-nl.osm.10.count
5689472
$ mclient -lx /tmp/planet-nl.osm.bug.10.xq >
/tmp/planet-nl.osm.bug.10.out
$ wc /tmp/planet-nl.osm.bug.10.out
  5689472  28725882 399286712 /tmp/planet-nl.osm.bug.10.out


----------------------------------------------------------------------

Comment By: Stefan de Konink (skinkie)
Date: 2008-08-24 17:41

Message:
Logged In: YES 
user_id=533026
Originator: YES

I'm sorry but a file *by far* too small to contain all the nodes.

Here is your question:

[EMAIL PROTECTED] ~ $ /opt/monetdb/bin/mclient -lx -g <
osm-all-sql-node.xq > node.sql-test
MAPI  = [EMAIL PROTECTED]:50000
ACTION= read_line
QUERY = for $node in doc("planet-nl.osm")/osm/node
ERROR = Connection terminated

# MonetDB Server v4.25.0
# based on GDK   v1.25.0
# Copyright (c) 1993-2008, CWI. All rights reserved.
# Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs; dynamically
linked.
# Visit http://monetdb.cwi.nl/ for further information.
# PF/Tijah module v0.5.0 loaded. http://dbappl.cs.utwente.nl/pftijah
# MonetDB/XQuery module v0.25.0 loaded (default back-end is 'algebra')
# XRPC administrative console at http://127.0.0.1:50001/admin
MonetDB>Segmentation fault

...specifically this version is non-debug, because I wanted to prepare a
*fast* demo.


----------------------------------------------------------------------

Comment By: Stefan Manegold (stmane)
Date: 2008-08-24 17:25

Message:
Logged In: YES 
user_id=572415
Originator: NO

maybe a more detailed analysis than `wc` & `grep`, i.e., manually inspect
the output, might shed some light on this ...


----------------------------------------------------------------------

Comment By: Stefan Manegold (stmane)
Date: 2008-08-24 17:20

Message:
Logged In: YES 
user_id=572415
Originator: NO

ps: haven't managed to analyze/fix the bug in ds_link() of module mkey
(cf.,
[ 2038906 ] XML attribute generation
http://sourceforge.net/tracker/index.php?func=detail&aid=2038906&group_id=56967&atid=482468
, yet, but we will look into this as soon as time permits...


----------------------------------------------------------------------

Comment By: Stefan Manegold (stmane)
Date: 2008-08-24 17:18

Message:
Logged In: YES 
user_id=572415
Originator: NO

Thanks.

The problem might be cause by problems in the element construction in the
Algebra back-end as, e.g., reported in
[ 2038906 ] XML attribute generation
http://sourceforge.net/tracker/index.php?func=detail&aid=2038906&group_id=56967&atid=482468

Could you please try whether the old "milprint_summer" back-end (`mclient
-lx -g`) shows the same (or other) problems, or whether is works fine?

In any case, I don't expect this to be in any way related to how/when
results are emitted, nor that any change in that would "solve" this bug
...


----------------------------------------------------------------------

Comment By: Stefan de Konink (skinkie)
Date: 2008-08-24 17:17

Message:
Logged In: YES 
user_id=533026
Originator: YES

And to be even more verbose:
[EMAIL PROTECTED] /var/tmp $ grep -c "<node " planet-nl-latest.osm
5689472

Is my flower broken?


----------------------------------------------------------------------

Comment By: Stefan de Konink (skinkie)
Date: 2008-08-24 17:06

Message:
Logged In: YES 
user_id=533026
Originator: YES

I expect the output file to have 5689472 lines. And the output file
doesn't have more lines than 4478?

http://hypercube.telascience.org/planet/planet-nl-080823.osm.gz is the
source input file. It has been added with update support and 10% overhead.
(I'm happy to give a login so you don't have to redo this process) The
server has been compiled with --enable-optimise.

And the script is as simple as the above.

----------------------------------------------------------------------

Comment By: Stefan Manegold (stmane)
Date: 2008-08-24 17:01

Message:
Logged In: YES 
user_id=572415
Originator: NO

Could you please be a bit more elaborate on what the bug is that you
report?

Please also (try to) provide all the information (incl. scripts and data,
or at least access/references to them) that is required to reproduce the
bug?

Thanks!


----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=482468&aid=2071638&group_id=56967

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Monetdb-bugs mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/monetdb-bugs

Reply via email to