[Zeitgeist] [Bug 639737] Re: Improve insertion times
** Changed in: zeitgeist Milestone: None = 0.8.0 -- You received this bug notification because you are a member of Zeitgeist Framework Team, which is subscribed to Zeitgeist Framework. https://bugs.launchpad.net/bugs/639737 Title: Improve insertion times Status in Zeitgeist Framework: In Progress Bug description: We insert pretty slowly with an average of 0.15 seconds for one event on my core i5 2.5 GHz beast. RainCT had some optimization possibilities: 1) PRAGMA synchronous=OFF 2) PRAGMA journal_mode=OFF The Chat: kamstrup I think we are - but I can't recall... in case of failed transactions - but I don't even know if we use transactions these days... seif RainCT try synchronous=OFF seif RainCT but it can corrupt your database if your phone dies while ZG is inserting seif RainCT and journal_mode=MEMORY seif RainCT or OFF since we don't use rollback anyway seif so maybe journal_mode = OFF is a good start? kamstrup okay, he's probably right... kamstrup 'grep -Ri rollback _zeitgeist/' is your friend :-) kamstrup apparently we are not using rollback... More info can be found here: http://www.sqlite.org/pragma.html In order to get a better picture of what's going on, can you please try to get some more information, like: 1) How many events are in your database? 2) What's the insertion time for one event into an empty db? 3) Out of this 0.15 secs, how many time is spend in our python code, and what's the time of the actual sql action? 4) How much faster is adding 10 events at once compared to adding them one at a time? 5) You think 0.15 secs is slow for inserting one event, what time do you expect, and why? ___ Mailing list: https://launchpad.net/~zeitgeist Post to : zeitgeist@lists.launchpad.net Unsubscribe : https://launchpad.net/~zeitgeist More help : https://help.launchpad.net/ListHelp
[Zeitgeist] [Bug 670358] Re: Add new aggregate API
** Changed in: zeitgeist Milestone: None = 0.8.0 -- You received this bug notification because you are a member of Zeitgeist Framework Team, which is subscribed to Zeitgeist Framework. https://bugs.launchpad.net/bugs/670358 Title: Add new aggregate API Status in Zeitgeist Framework: Confirmed Bug description: Zeitgeist API can give us vague information but not statistics over the API Use case: - Give me counts of every subject_text from actor = Unity Currently to do that one will need to either: Request all events with Unity as an Actor and count the subject_text This can be done much better IMHO I am thinking of an Aggregation Extension. But before we hack on that we need to agree if its necessary and how the API will look like. ___ Mailing list: https://launchpad.net/~zeitgeist Post to : zeitgeist@lists.launchpad.net Unsubscribe : https://launchpad.net/~zeitgeist More help : https://help.launchpad.net/ListHelp
[Zeitgeist] [Bug 632363] Re: Slow queries: SQL indexes not used
** Changed in: zeitgeist Milestone: None = 0.8.0 -- You received this bug notification because you are a member of Zeitgeist Framework Team, which is subscribed to Zeitgeist Framework. https://bugs.launchpad.net/bugs/632363 Title: Slow queries: SQL indexes not used Status in Zeitgeist Framework: Confirmed Bug description: THE PROBLEM: I am seeing query times around 200ms (and 150ms with my latest performance tweak in trunk), which surprised me as quite slow since my queries where quite simple. I had expected times around 1-2ms. Reading up on the sqlite documentation I see that the queries we generate are pretty far from optimized in an sqlite world [1]. The case is that when ever you use an OR sqlite will no longer use an index. Thus this query is NOT using the indexes: SELECT * FROM event WHERE interpretation=1 OR interpretation=2 But if we rewrite it using IN instead the indexes will be used: SELECT * FROM event WHERE interpretation IN (1, 2) This also explains the case where Michal where seeing tremendously slow query times when searching for a big range of mimetypes. Looking in _zeitgeist.engine.sql.WhereClause.add_text_condition() I am also pretty sure we are not using the indexes for prefix queries (eg file://home/*). THE SOLUTION I *definitely* don't think we should panic and feverishly start rewriting our query compilation. Here's what I propose: 1) Implement an envvar ZEITGEIST_DEBUG_QUERY_PLANS which will spit out all our SQL calls and the query plans for each of our calls. The query plan will tell us how the db is queried and which indexes are used if any. The query plan is obtained by prefixing the SQL statement with EXPLAIN QUERY PLAN. 2) Collect some useful intelligence with this new tool, and generally learn more about how we can optimize sqlite queries. A big question here is how the event_view VIEW impacts the query plan. 3) Write a new template - SQL compilation engine that generates SQL optimized for sqlite. We can actually be quite clever about grouping our OR statements into IN clauses - but it will be tricky to get right. NOTE: That this doesn't imply any change in the public API or event template system. That would be the wrong solution imho. Our current API is nice and simple by my standards. Let's keep it that way. [1]: See fx the section Using Indexes To Speed Searching in http://www.sqlite.org/vdbe.html ___ Mailing list: https://launchpad.net/~zeitgeist Post to : zeitgeist@lists.launchpad.net Unsubscribe : https://launchpad.net/~zeitgeist More help : https://help.launchpad.net/ListHelp
[Zeitgeist] [Bug 704931] [NEW] Publish property names, accesslevel and type in introspection data
Public bug reported: Our .Log dbus interface has two properties, version and extensions. It would be great if we could publish their existence in the introspect xml data. [0] is one example of how this can be achieved in python. [0] http://bazaar.launchpad.net/~aptdaemon- developers/aptdaemon/main/view/head:/aptdaemon/core.py#L150 ** Affects: zeitgeist Importance: Undecided Assignee: Markus Korn (thekorn) Status: New ** Changed in: zeitgeist Assignee: (unassigned) = Markus Korn (thekorn) -- You received this bug notification because you are a member of Zeitgeist Framework Team, which is subscribed to Zeitgeist Framework. https://bugs.launchpad.net/bugs/704931 Title: Publish property names, accesslevel and type in introspection data Status in Zeitgeist Framework: New Bug description: Our .Log dbus interface has two properties, version and extensions. It would be great if we could publish their existence in the introspect xml data. [0] is one example of how this can be achieved in python. [0] http://bazaar.launchpad.net/~aptdaemon- developers/aptdaemon/main/view/head:/aptdaemon/core.py#L150 ___ Mailing list: https://launchpad.net/~zeitgeist Post to : zeitgeist@lists.launchpad.net Unsubscribe : https://launchpad.net/~zeitgeist More help : https://help.launchpad.net/ListHelp
[Zeitgeist] [Bug 597691] Re: Please push to latest FF (3.6.*)
Ian i am assigning to the correct package Please look at this bug which describes something similar https://bugs.launchpad.net/zeitgeist-dataproviders/+bug/672079 If it is i will mark it as a duplicate. cheers ** Project changed: zeitgeist-firefox-extension = zeitgeist- dataproviders -- You received this bug notification because you are a member of Zeitgeist Framework Team, which is subscribed to Zeitgeist Data-Sources. https://bugs.launchpad.net/bugs/597691 Title: Please push to latest FF (3.6.*) Status in Zeitgeist Data-Sources: Incomplete Status in Ubuntu: Invalid Bug description: I hope i could test the extension on Ubuntu 10.04. Please push to latest version of FF ___ Mailing list: https://launchpad.net/~zeitgeist Post to : zeitgeist@lists.launchpad.net Unsubscribe : https://launchpad.net/~zeitgeist More help : https://help.launchpad.net/ListHelp
[Zeitgeist] [Bug 704934] [NEW] emacs data provider could (provide 'zeitgeist)
Public bug reported: Here is the trivial patch: $ bzr diff zeitgeist-dataproviders/emacs/zeitgeist.el === modified file 'emacs/zeitgeist.el' --- emacs/zeitgeist.el 2010-08-08 17:06:04 + +++ emacs/zeitgeist.el 2011-01-19 14:02:25 + @@ -186,4 +186,6 @@ (add-hook 'kill-emacs-hook 'zeitgeist-kill-emacs-hook) (add-hook 'before-save-hook 'zeitgeist-before-save-hook) +(provide 'zeitgeist) + ;;; zeitgeist.el ends here Without this, when I evaluate (require 'zeitgeist), I get the predictable: Debugger entered--Lisp error: (error Required feature `zeitgeist' was not provided) require(zeitgeist) eval((require (quote zeitgeist))) eval-last-sexp-1(nil) eval-last-sexp(nil) call-interactively(eval-last-sexp nil nil) ...when zeitgeist.el is loaded. ** Affects: zeitgeist-dataproviders Importance: Undecided Status: New -- You received this bug notification because you are a member of Zeitgeist Framework Team, which is subscribed to Zeitgeist Data-Sources. https://bugs.launchpad.net/bugs/704934 Title: emacs data provider could (provide 'zeitgeist) Status in Zeitgeist Data-Sources: New Bug description: Here is the trivial patch: $ bzr diff zeitgeist-dataproviders/emacs/zeitgeist.el === modified file 'emacs/zeitgeist.el' --- emacs/zeitgeist.el 2010-08-08 17:06:04 + +++ emacs/zeitgeist.el 2011-01-19 14:02:25 + @@ -186,4 +186,6 @@ (add-hook 'kill-emacs-hook 'zeitgeist-kill-emacs-hook) (add-hook 'before-save-hook 'zeitgeist-before-save-hook) +(provide 'zeitgeist) + ;;; zeitgeist.el ends here Without this, when I evaluate (require 'zeitgeist), I get the predictable: Debugger entered--Lisp error: (error Required feature `zeitgeist' was not provided) require(zeitgeist) eval((require (quote zeitgeist))) eval-last-sexp-1(nil) eval-last-sexp(nil) call-interactively(eval-last-sexp nil nil) ...when zeitgeist.el is loaded. ___ Mailing list: https://launchpad.net/~zeitgeist Post to : zeitgeist@lists.launchpad.net Unsubscribe : https://launchpad.net/~zeitgeist More help : https://help.launchpad.net/ListHelp
[Zeitgeist] [Merge] lp:~federico-gnome/zeitgeist/fixes into lp:zeitgeist
Federico Mena Quintero has proposed merging lp:~federico-gnome/zeitgeist/fixes into lp:zeitgeist. Requested reviews: Zeitgeist Framework Team (zeitgeist) For more details, see: https://code.launchpad.net/~federico-gnome/zeitgeist/fixes/+merge/46803 Removes the check for 'rdfpipe' from configure.ac. That program is not actually needed, and comes from an obscure package (rdfextras from Google Code). -- https://code.launchpad.net/~federico-gnome/zeitgeist/fixes/+merge/46803 Your team Zeitgeist Framework Team is requested to review the proposed merge of lp:~federico-gnome/zeitgeist/fixes into lp:zeitgeist. === modified file 'configure.ac' --- configure.ac 2011-01-18 10:49:04 + +++ configure.ac 2011-01-19 19:21:30 + @@ -37,10 +37,4 @@ AC_MSG_ERROR(You need the tool `rapper' from the `raptor-utils' package in order to compile Zeitgeist) fi -# check for rdflib -AC_CHECK_PROG(HAVE_RDFLIB, rdfpipe, yes, no) -if test x$HAVE_RDFLIB = xno; then - AC_MSG_ERROR(You need the tool `rdfpipe' from the `python-rdflib' package in order to compile Zeitgeist) -fi - AC_OUTPUT ___ Mailing list: https://launchpad.net/~zeitgeist Post to : zeitgeist@lists.launchpad.net Unsubscribe : https://launchpad.net/~zeitgeist More help : https://help.launchpad.net/ListHelp
[Zeitgeist] [Bug 673008] Re: Reinstall monitors upon startup
** Changed in: zeitgeist-sharp Milestone: 0.1.1 = None -- You received this bug notification because you are a member of Zeitgeist Framework Team, which is subscribed to Zeitgeist Framework. https://bugs.launchpad.net/bugs/673008 Title: Reinstall monitors upon startup Status in Zeitgeist Framework: Confirmed Status in Zeitgeist Sharp: Confirmed Bug description: When for some reason zeitgeist restarts all monitors are then gone Quoting kamstrup: And fwiw - libzeitgeist detects when the daemon comes and goes and reinstates any monitors it has running - so restarting the daemon is not an issue for libzeitgeist customers We should look into having that in the python and zeitgeist-sharp wrappers ___ Mailing list: https://launchpad.net/~zeitgeist Post to : zeitgeist@lists.launchpad.net Unsubscribe : https://launchpad.net/~zeitgeist More help : https://help.launchpad.net/ListHelp
Re: [Zeitgeist] [Question #122906]: Can zeitgeist track application focus time?
Question #122906 on Zeitgeist Framework changed: https://answers.launchpad.net/zeitgeist/+question/122906 mar proposed the following answer: Tracking applications would be great! I vote for it! -- You received this question notification because you are a member of Zeitgeist Framework Team, which is an answer contact for Zeitgeist Framework. ___ Mailing list: https://launchpad.net/~zeitgeist Post to : zeitgeist@lists.launchpad.net Unsubscribe : https://launchpad.net/~zeitgeist More help : https://help.launchpad.net/ListHelp
Re: [Zeitgeist] [Merge] lp:~federico-gnome/zeitgeist/fixes into lp:zeitgeist
I believe that it's a shorthand check for the python-rdflib package. In Ubuntu, at least, that package ships this tool. We python-rdflib for parsing the ontologies at build time -- https://code.launchpad.net/~federico-gnome/zeitgeist/fixes/+merge/46803 Your team Zeitgeist Framework Team is requested to review the proposed merge of lp:~federico-gnome/zeitgeist/fixes into lp:zeitgeist. ___ Mailing list: https://launchpad.net/~zeitgeist Post to : zeitgeist@lists.launchpad.net Unsubscribe : https://launchpad.net/~zeitgeist More help : https://help.launchpad.net/ListHelp
Re: [Zeitgeist] [Merge] lp:~federico-gnome/zeitgeist/fixes into lp:zeitgeist
Maybe we can replace the check for rdfpipe with something ala: python -c import rdflib if [ $? != 0 ]; then echo You need the Python module 'rdflib' in order to compile Zeitgeist exit 1 fi -- https://code.launchpad.net/~federico-gnome/zeitgeist/fixes/+merge/46803 Your team Zeitgeist Framework Team is requested to review the proposed merge of lp:~federico-gnome/zeitgeist/fixes into lp:zeitgeist. ___ Mailing list: https://launchpad.net/~zeitgeist Post to : zeitgeist@lists.launchpad.net Unsubscribe : https://launchpad.net/~zeitgeist More help : https://help.launchpad.net/ListHelp
Re: [Zeitgeist] [Bug 704931] [NEW] Publish property names, accesslevel and type in introspection data
I agree in principle that this is desirable, but comparing the relatively small gains to the complexity in the URL provided by Markus I am not sure I think it's worth it... ___ Mailing list: https://launchpad.net/~zeitgeist Post to : zeitgeist@lists.launchpad.net Unsubscribe : https://launchpad.net/~zeitgeist More help : https://help.launchpad.net/ListHelp
