Re: [Sedna-discussion] How to calculate hash in XQuery
Done. Ivan Shcheklein Sedna Team On Sat, Apr 13, 2013 at 12:19 AM, Ivan Lagunov wrote: > Hi Ivan, > > I've created a feature request for this: > https://sourceforge.net/p/sedna/bugs/95/ > > I've put it in Bugs section by accident. Could you move it to Feature > requests or shall I create it again there? > > Best regards, > Ivan Lagunov > > On Apr 12, 2013, at 9:42 PM, Ivan Shcheklein wrote: > > Yes, I think we'll add these functions. It's not very hard. > > Ivan Shcheklein, > Sedna Team > > > On Fri, Apr 12, 2013 at 11:37 PM, Ilya Taranov wrote: > >> Hi, >> >> The easiest (and the only right, in fact) way to do this is to use >> external functions: >> http://www.sedna.org/progguide/ProgGuidesu5.html#x9-390002.2.5 >> >> You may also leave a feature request for internal support. This one >> probably may be satisfied in a short time. >> >> Thanks, >> Ilya Taranov. >> >> On Fri, Apr 12, 2013 at 10:23 AM, Ivan Lagunov wrote: >> >>> Hello, >>> >>> ** ** >>> >>> Is there a way to calculate hash in XQuery for Sedna? Ideally I’d like >>> to have something like this module for BaseX: >>> >>> http://docs.basex.org/wiki/Hashing_Module >>> >>> ** ** >>> >>> Best regards, >>> >>> Ivan Lagunov >>> >>> >>> -- >>> Precog is a next-generation analytics platform capable of advanced >>> analytics on semi-structured data. The platform includes APIs for >>> building >>> apps and a phenomenal toolset for data science. Developers can use >>> our toolset for easy data analysis & visualization. Get a free account! >>> http://www2.precog.com/precogplatform/slashdotnewsletter >>> ___ >>> Sedna-discussion mailing list >>> Sedna-discussion@lists.sourceforge.net >>> https://lists.sourceforge.net/lists/listinfo/sedna-discussion >>> >>> >> >> >> -- >> Precog is a next-generation analytics platform capable of advanced >> analytics on semi-structured data. The platform includes APIs for building >> apps and a phenomenal toolset for data science. Developers can use >> our toolset for easy data analysis & visualization. Get a free account! >> http://www2.precog.com/precogplatform/slashdotnewsletter >> ___ >> Sedna-discussion mailing list >> Sedna-discussion@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/sedna-discussion >> >> > > -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ Sedna-discussion mailing list Sedna-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sedna-discussion
Re: [Sedna-discussion] How to calculate hash in XQuery
Hi Ivan, I've created a feature request for this: https://sourceforge.net/p/sedna/bugs/95/ I've put it in Bugs section by accident. Could you move it to Feature requests or shall I create it again there? Best regards, Ivan Lagunov On Apr 12, 2013, at 9:42 PM, Ivan Shcheklein wrote: > Yes, I think we'll add these functions. It's not very hard. > > Ivan Shcheklein, > Sedna Team > > > On Fri, Apr 12, 2013 at 11:37 PM, Ilya Taranov wrote: > Hi, > > The easiest (and the only right, in fact) way to do this is to use external > functions: > http://www.sedna.org/progguide/ProgGuidesu5.html#x9-390002.2.5 > > You may also leave a feature request for internal support. This one probably > may be satisfied in a short time. > > Thanks, > Ilya Taranov. > > On Fri, Apr 12, 2013 at 10:23 AM, Ivan Lagunov wrote: > Hello, > > > > Is there a way to calculate hash in XQuery for Sedna? Ideally I’d like to > have something like this module for BaseX: > > http://docs.basex.org/wiki/Hashing_Module > > > > Best regards, > > Ivan Lagunov > > > -- > Precog is a next-generation analytics platform capable of advanced > analytics on semi-structured data. The platform includes APIs for building > apps and a phenomenal toolset for data science. Developers can use > our toolset for easy data analysis & visualization. Get a free account! > http://www2.precog.com/precogplatform/slashdotnewsletter > ___ > Sedna-discussion mailing list > Sedna-discussion@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/sedna-discussion > > > > -- > Precog is a next-generation analytics platform capable of advanced > analytics on semi-structured data. The platform includes APIs for building > apps and a phenomenal toolset for data science. Developers can use > our toolset for easy data analysis & visualization. Get a free account! > http://www2.precog.com/precogplatform/slashdotnewsletter > ___ > Sedna-discussion mailing list > Sedna-discussion@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/sedna-discussion > > -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ Sedna-discussion mailing list Sedna-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sedna-discussion
Re: [Sedna-discussion] How to locate XQuery errors
Hi Ivan, I've created a feature request: https://sourceforge.net/p/sedna/feature-requests/18/ BTW, it's not enough to add this info in debug mode. It'd be much more comfortable to see the function name to speed up investigation of issues on Production system. Also debug mode is not available in XML:DB API. Best regards, Ivan Lagunov On Apr 12, 2013, at 9:47 PM, Ivan Shcheklein wrote: > Ilya, Ivan, you can get stack trace > http://sedna.org/progguide/ProgGuidesu10.html#x16-630002.7.2 :) > > Unfortunately, it misses function names. Though, it should be easy to add, I > believe. > > > On Fri, Apr 12, 2013 at 11:43 PM, Ilya Taranov wrote: > Hi, > > That is would be great is we printed an XQuery stack trace, I suppose. > It's definitely not hard, but we should take a look. > > Thanks, > Ilya Taranov. > > On Fri, Apr 12, 2013 at 9:10 AM, Ivan Lagunov wrote: > Hello, > > > > We extensively use XQuery modules in Sedna. When an error happens, what we > see is something like this: > > > > ERROR 12/04/2013 17:53:48 (TRN nxp pid=32721 sid=45 trid=37) > [PPSeqChecker.cpp:do_next:75]: (XPTY0019) It is a type error if the result of > a step (other than the last step) in a path expression contains an atomic > value. Details: at (45:25), filter step contains atomic in position 1 > > > > This is a good message showing (row:column) information that helps a lot. > However, it misses the module name that is really uncomfortable. It’d be > really nice to see the module name and preferably the function name if it’s > available. Is it something easy to implement? > > > > Best regards, > > Ivan Lagunov > > > -- > Precog is a next-generation analytics platform capable of advanced > analytics on semi-structured data. The platform includes APIs for building > apps and a phenomenal toolset for data science. Developers can use > our toolset for easy data analysis & visualization. Get a free account! > http://www2.precog.com/precogplatform/slashdotnewsletter > ___ > Sedna-discussion mailing list > Sedna-discussion@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/sedna-discussion > > > > -- > Precog is a next-generation analytics platform capable of advanced > analytics on semi-structured data. The platform includes APIs for building > apps and a phenomenal toolset for data science. Developers can use > our toolset for easy data analysis & visualization. Get a free account! > http://www2.precog.com/precogplatform/slashdotnewsletter > ___ > Sedna-discussion mailing list > Sedna-discussion@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/sedna-discussion > > -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ Sedna-discussion mailing list Sedna-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sedna-discussion
Re: [Sedna-discussion] Sedna-discussion Digest, Vol 80, Issue 6
Is it possible to have the fn:doc-available() function made as a new sedna stable release (e.g. sedna-3.5.162-bin-linux-x64.sh currently it is: sedna-3.5.161-bin-linux-x64.sh)? If so, when can we expect to have it? Thank you, Jocelyn Raymond -- Team Lead Information Systems Office of the Registrar University of Alberta 780.492.3874 -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ Sedna-discussion mailing list Sedna-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sedna-discussion
Re: [Sedna-discussion] How to locate XQuery errors
Ilya, Ivan, you can get stack trace http://sedna.org/progguide/ProgGuidesu10.html#x16-630002.7.2 :) Unfortunately, it misses function names. Though, it should be easy to add, I believe. On Fri, Apr 12, 2013 at 11:43 PM, Ilya Taranov wrote: > Hi, > > That is would be great is we printed an XQuery stack trace, I suppose. > It's definitely not hard, but we should take a look. > > Thanks, > Ilya Taranov. > > On Fri, Apr 12, 2013 at 9:10 AM, Ivan Lagunov wrote: > >> Hello, >> >> ** ** >> >> We extensively use XQuery modules in Sedna. When an error happens, what >> we see is something like this: >> >> ** ** >> >> ERROR 12/04/2013 17:53:48 (TRN nxp pid=32721 sid=45 trid=37) >> [PPSeqChecker.cpp:do_next:75]: (XPTY0019) It is a type error if the result >> of a step (other than the last step) in a path expression contains an >> atomic value. Details: at (45:25), filter step contains atomic in position 1 >> >> >> ** ** >> >> This is a good message showing (row:column) information that helps a lot. >> However, it misses the module name that is really uncomfortable. It’d be >> really nice to see the module name and preferably the function name if it’s >> available. Is it something easy to implement? >> >> ** ** >> >> Best regards, >> >> Ivan Lagunov >> >> >> -- >> Precog is a next-generation analytics platform capable of advanced >> analytics on semi-structured data. The platform includes APIs for building >> apps and a phenomenal toolset for data science. Developers can use >> our toolset for easy data analysis & visualization. Get a free account! >> http://www2.precog.com/precogplatform/slashdotnewsletter >> ___ >> Sedna-discussion mailing list >> Sedna-discussion@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/sedna-discussion >> >> > > > -- > Precog is a next-generation analytics platform capable of advanced > analytics on semi-structured data. The platform includes APIs for building > apps and a phenomenal toolset for data science. Developers can use > our toolset for easy data analysis & visualization. Get a free account! > http://www2.precog.com/precogplatform/slashdotnewsletter > ___ > Sedna-discussion mailing list > Sedna-discussion@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/sedna-discussion > > -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ Sedna-discussion mailing list Sedna-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sedna-discussion
Re: [Sedna-discussion] How to locate XQuery errors
Hi, That is would be great is we printed an XQuery stack trace, I suppose. It's definitely not hard, but we should take a look. Thanks, Ilya Taranov. On Fri, Apr 12, 2013 at 9:10 AM, Ivan Lagunov wrote: > Hello, > > ** ** > > We extensively use XQuery modules in Sedna. When an error happens, what we > see is something like this: > > ** ** > > ERROR 12/04/2013 17:53:48 (TRN nxp pid=32721 sid=45 trid=37) > [PPSeqChecker.cpp:do_next:75]: (XPTY0019) It is a type error if the result > of a step (other than the last step) in a path expression contains an > atomic value. Details: at (45:25), filter step contains atomic in position 1 > > > ** ** > > This is a good message showing (row:column) information that helps a lot. > However, it misses the module name that is really uncomfortable. It’d be > really nice to see the module name and preferably the function name if it’s > available. Is it something easy to implement? > > ** ** > > Best regards, > > Ivan Lagunov > > > -- > Precog is a next-generation analytics platform capable of advanced > analytics on semi-structured data. The platform includes APIs for building > apps and a phenomenal toolset for data science. Developers can use > our toolset for easy data analysis & visualization. Get a free account! > http://www2.precog.com/precogplatform/slashdotnewsletter > ___ > Sedna-discussion mailing list > Sedna-discussion@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/sedna-discussion > > -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ Sedna-discussion mailing list Sedna-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sedna-discussion
Re: [Sedna-discussion] How to calculate hash in XQuery
Yes, I think we'll add these functions. It's not very hard. Ivan Shcheklein, Sedna Team On Fri, Apr 12, 2013 at 11:37 PM, Ilya Taranov wrote: > Hi, > > The easiest (and the only right, in fact) way to do this is to use > external functions: > http://www.sedna.org/progguide/ProgGuidesu5.html#x9-390002.2.5 > > You may also leave a feature request for internal support. This one > probably may be satisfied in a short time. > > Thanks, > Ilya Taranov. > > On Fri, Apr 12, 2013 at 10:23 AM, Ivan Lagunov wrote: > >> Hello, >> >> ** ** >> >> Is there a way to calculate hash in XQuery for Sedna? Ideally I’d like to >> have something like this module for BaseX: >> >> http://docs.basex.org/wiki/Hashing_Module >> >> ** ** >> >> Best regards, >> >> Ivan Lagunov >> >> >> -- >> Precog is a next-generation analytics platform capable of advanced >> analytics on semi-structured data. The platform includes APIs for building >> apps and a phenomenal toolset for data science. Developers can use >> our toolset for easy data analysis & visualization. Get a free account! >> http://www2.precog.com/precogplatform/slashdotnewsletter >> ___ >> Sedna-discussion mailing list >> Sedna-discussion@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/sedna-discussion >> >> > > > -- > Precog is a next-generation analytics platform capable of advanced > analytics on semi-structured data. The platform includes APIs for building > apps and a phenomenal toolset for data science. Developers can use > our toolset for easy data analysis & visualization. Get a free account! > http://www2.precog.com/precogplatform/slashdotnewsletter > ___ > Sedna-discussion mailing list > Sedna-discussion@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/sedna-discussion > > -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ Sedna-discussion mailing list Sedna-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sedna-discussion
Re: [Sedna-discussion] How to calculate hash in XQuery
Hi, The easiest (and the only right, in fact) way to do this is to use external functions: http://www.sedna.org/progguide/ProgGuidesu5.html#x9-390002.2.5 You may also leave a feature request for internal support. This one probably may be satisfied in a short time. Thanks, Ilya Taranov. On Fri, Apr 12, 2013 at 10:23 AM, Ivan Lagunov wrote: > Hello, > > ** ** > > Is there a way to calculate hash in XQuery for Sedna? Ideally I’d like to > have something like this module for BaseX: > > http://docs.basex.org/wiki/Hashing_Module > > ** ** > > Best regards, > > Ivan Lagunov > > > -- > Precog is a next-generation analytics platform capable of advanced > analytics on semi-structured data. The platform includes APIs for building > apps and a phenomenal toolset for data science. Developers can use > our toolset for easy data analysis & visualization. Get a free account! > http://www2.precog.com/precogplatform/slashdotnewsletter > ___ > Sedna-discussion mailing list > Sedna-discussion@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/sedna-discussion > > -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ Sedna-discussion mailing list Sedna-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sedna-discussion
[Sedna-discussion] How to calculate hash in XQuery
Hello, Is there a way to calculate hash in XQuery for Sedna? Ideally I'd like to have something like this module for BaseX: http://docs.basex.org/wiki/Hashing_Module Best regards, Ivan Lagunov -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ Sedna-discussion mailing list Sedna-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sedna-discussion
[Sedna-discussion] How to locate XQuery errors
Hello, We extensively use XQuery modules in Sedna. When an error happens, what we see is something like this: ERROR 12/04/2013 17:53:48 (TRN nxp pid=32721 sid=45 trid=37) [PPSeqChecker.cpp:do_next:75]: (XPTY0019) It is a type error if the result of a step (other than the last step) in a path expression contains an atomic value. Details: at (45:25), filter step contains atomic in position 1 This is a good message showing (row:column) information that helps a lot. However, it misses the module name that is really uncomfortable. It'd be really nice to see the module name and preferably the function name if it's available. Is it something easy to implement? Best regards, Ivan Lagunov -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ Sedna-discussion mailing list Sedna-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sedna-discussion
Re: [Sedna-discussion] DB API performance issue - fn:doc-available
Hi Guys, Yes, I'll sort this out later and issue a new release. Just please tell me which specific version of Sedna this new functionality came in please? Kind Regards, Charles On 12 Apr 2013, at 16:33, "Ivan Lagunov" wrote: > P.S. This is the corresponding commit: > http://sedna.org/gitweb/sedna.git/commit/a7306ad318593d7ff308628f8cfb542ddfa672b2 > As it’s dated by today, I expect it’ll be available in the night builds since > tomorrow. > > @Ivan, please correct me if I’m wrong. > > Best regards, > Ivan Lagunov > > From: Ivan Lagunov [mailto:lagi...@gmail.com] > Sent: Friday, April 12, 2013 5:30 PM > To: 'Charles Foster' > Cc: 'sedna-discussion'; 'Ivan Shcheklein' > Subject: XML:DB API performance issue - fn:doc-available > > Hi Charles, > > We’re having serious performance issues, probably reached the critical number > of documents in the database. According to Ivan Shcheklein, it is likely to > be caused by using doc(“documents”) function that actually locks all > collections in the database, thus, drastically decreasing performance. Your > implementation of XML:DB API works great for small datasets but according to > event.log it uses doc(“documents”) quite a lot. So it may indeed result in > bad performance I’m facing. As an improvement, there have been implemented a > function fn:doc-available that checks if a document is available in the given > collection. It locks only one collection. This is an example of usage: > > doc-available(“collection”, “document”) > > Could you please update the Sedna XML:DB API implementation using this > function? I understand it’s recommended to migrate to XQJ implementation but > it’s really hard to rewrite all the code we have. Nevertheless, I’ve planned > to investigate required efforts for this migration but we need some solution > on short notice. Thanks a lot! > > Best regards, > Ivan Lagunov -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ Sedna-discussion mailing list Sedna-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sedna-discussion
Re: [Sedna-discussion] DB API performance issue - fn:doc-available
Charles, Development build will be available tomorrow: http://modis.ispras.ru/FTPContent/sedna/development/ . Version will be >= 3.5.602. Or you can get latest sources: git clone git://modis.ispras.ru/sedna . Thank you for your prompt response! As far as I remember, there are other users waiting for this improvement. Ivan Shcheklein, Sedna Team Ivan Shcheklein, Sedna Team On Fri, Apr 12, 2013 at 7:36 PM, Charles Foster wrote: > Hi Guys, > > Yes, I'll sort this out later and issue a new release. > > Just please tell me which specific version of Sedna this new functionality > came in please? > > Kind Regards, > > Charles > > On 12 Apr 2013, at 16:33, "Ivan Lagunov" wrote: > > P.S. This is the corresponding commit: > http://sedna.org/gitweb/sedna.git/commit/a7306ad318593d7ff308628f8cfb542ddfa672b2 > > As it’s dated by today, I expect it’ll be available in the night builds > since tomorrow. > ** ** > @Ivan, please correct me if I’m wrong. > ** ** > Best regards, > Ivan Lagunov > > *From:* Ivan Lagunov [mailto:lagi...@gmail.com] > *Sent:* Friday, April 12, 2013 5:30 PM > *To:* 'Charles Foster' > *Cc:* 'sedna-discussion'; 'Ivan Shcheklein' > *Subject:* XML:DB API performance issue - fn:doc-available > ** ** > Hi Charles, > ** ** > We’re having serious performance issues, probably reached the critical > number of documents in the database. According to Ivan Shcheklein, it is > likely to be caused by using doc(“documents”) function that actually locks > all collections in the database, thus, drastically decreasing performance. > Your implementation of XML:DB API works great for small datasets but > according to event.log it uses doc(“documents”) quite a lot. So it may > indeed result in bad performance I’m facing. As an improvement, there have > been implemented a function fn:doc-available that checks if a document is > available in the given collection. It locks only one collection. This is an > example of usage: > ** ** > doc-available(“collection”, “document”) > ** ** > Could you please update the Sedna XML:DB API implementation using this > function? I understand it’s recommended to migrate to XQJ implementation > but it’s really hard to rewrite all the code we have. Nevertheless, I’ve > planned to investigate required efforts for this migration but we need some > solution on short notice. Thanks a lot! > ** ** > Best regards, > Ivan Lagunov > > > -- Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account! http://www2.precog.com/precogplatform/slashdotnewsletter___ Sedna-discussion mailing list Sedna-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sedna-discussion
Re: [Sedna-discussion] DB API performance issue - fn:doc-available
P.S. This is the corresponding commit:
http://sedna.org/gitweb/sedna.git/commit/a7306ad318593d7ff308628f8cfb542ddfa
672b2
As it's dated by today, I expect it'll be available in the night builds
since tomorrow.
@Ivan, please correct me if I'm wrong.
Best regards,
Ivan Lagunov
From: Ivan Lagunov [mailto:lagi...@gmail.com]
Sent: Friday, April 12, 2013 5:30 PM
To: 'Charles Foster'
Cc: 'sedna-discussion'; 'Ivan Shcheklein'
Subject: XML:DB API performance issue - fn:doc-available
Hi Charles,
We're having serious performance issues, probably reached the critical
number of documents in the database. According to Ivan Shcheklein, it is
likely to be caused by using doc("documents") function that actually locks
all collections in the database, thus, drastically decreasing performance.
Your implementation of XML:DB API works great for small datasets but
according to event.log it uses doc("documents") quite a lot. So it may
indeed result in bad performance I'm facing. As an improvement, there have
been implemented a function fn:doc-available that checks if a document is
available in the given collection. It locks only one collection. This is an
example of usage:
doc-available("collection", "document")
Could you please update the Sedna XML:DB API implementation using this
function? I understand it's recommended to migrate to XQJ implementation but
it's really hard to rewrite all the code we have. Nevertheless, I've planned
to investigate required efforts for this migration but we need some solution
on short notice. Thanks a lot!
Best regards,
Ivan Lagunov
--
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter___
Sedna-discussion mailing list
Sedna-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/sedna-discussion
[Sedna-discussion] XML:DB API performance issue - fn:doc-available
Hi Charles,
We're having serious performance issues, probably reached the critical
number of documents in the database. According to Ivan Shcheklein, it is
likely to be caused by using doc("documents") function that actually locks
all collections in the database, thus, drastically decreasing performance.
Your implementation of XML:DB API works great for small datasets but
according to event.log it uses doc("documents") quite a lot. So it may
indeed result in bad performance I'm facing. As an improvement, there have
been implemented a function fn:doc-available that checks if a document is
available in the given collection. It locks only one collection. This is an
example of usage:
doc-available("collection", "document")
Could you please update the Sedna XML:DB API implementation using this
function? I understand it's recommended to migrate to XQJ implementation but
it's really hard to rewrite all the code we have. Nevertheless, I've planned
to investigate required efforts for this migration but we need some solution
on short notice. Thanks a lot!
Best regards,
Ivan Lagunov
--
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter___
Sedna-discussion mailing list
Sedna-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/sedna-discussion
