[basex-talk] upgrade of BaseX from 8.6.5 to 8.6.6 how to migrate the data?

2017-09-15 Thread Stefania Axo
hi I want to upgrade from 8.6.5 to 8.6.6. How do i migrate the data? do i just copy over the Basex\data folder? thanks Stefania

Re: [basex-talk] Basex Inner Workings

2017-09-15 Thread Graydon Saunders
As a follow-on to Dirk, it's amazing how much of a performance difference it can make to use typed variables when you're constructing something for output. (So far as I can tell, variables declarations function as an "optimize this!" flag for BaseX.) If you get good performance when you're just

Re: [basex-talk] Basex Inner Workings

2017-09-15 Thread Kirsten, Dirk
Hello Athanasios, I think you should really check the actual query plan which is executed. If you have such a huge spike in performance surely they processor will be executing it differently. I don't think looking into file access patterns BaseX internally uses is very useful for an end user.

Re: [basex-talk] Basex Inner Workings

2017-09-15 Thread Fabrice ETANCHAUD
You can find the time spent in each step in the query info bar graph. If you are looking for the schema and the facets of your dataset, you should have a look at the index module, and for sure at index:facets() Best regards, Fabrice -Message d'origine- De : Anastasiou A.

Re: [basex-talk] Basex Inner Workings

2017-09-15 Thread Anastasiou A .
Thank you Fabrice. I understand. I have not tried querying from the command prompt or sending the output to a file directly, which I could also work with. But, my understanding is that the time we are being quoted by the gui is the DB time, not taking into account the time it takes for the

Re: [basex-talk] Basex Inner Workings

2017-09-15 Thread Fabrice ETANCHAUD
I understand that you are reformatting a lot of data, aren't you ? I will have only little advice, because this is not my use case. >From what I know, resulting document will be materialized entirely in memory >before presentation or export. You should export your results to disk, in order not

Re: [basex-talk] Basex Inner Workings

2017-09-15 Thread Anastasiou A .
Hello Fabrice Yes, I am having a query which jumped from ~1500 ms to about a minute with a tiny little change... The DB is about 2GB and it is my test set before putting the query to work on the full dataset. The change was to go from simply returning the nodes themselves with a `return

Re: [basex-talk] Basex Inner Workings

2017-09-15 Thread Anastasiou A .
Hello Alexander The thesis is a fantastic resource for getting to know a bit more about Basex's inner workings, thank you very much. I had seen the storage_layout already but I was trying to understand if there is anything that can be done at the file system level. This was also because I

Re: [basex-talk] Basex Inner Workings

2017-09-15 Thread Alexander Holupirek
> On 15. Sep 2017, at 14:00, Anastasiou A. wrote: > Quick question: Is there any document / URL where I could find out more about > how does Basex access the disk during its operation? > > For example, are there any reads to be expected during executing a query?

Re: [basex-talk] Basex Inner Workings

2017-09-15 Thread Fabrice ETANCHAUD
Hi Athanasios, Did you experience slow queries ? Are you sure to use all the index features ? Are these queries operational ones (direct access on a key value) or analytics ? I never experienced slow queries, even on huge xml corpus (patent registrations), But this is at the cost of longer

[basex-talk] Basex Inner Workings

2017-09-15 Thread Anastasiou A .
Hello everyone Quick question: Is there any document / URL where I could find out more about how does Basex access the disk during its operation? For example, are there any reads to be expected during executing a query? Through iotop, I can see 3-4 processes reading during startup, then