http://www.netlib.org/lapack/lapacke.html a C api to lapack
2014-07-08 16:23 GMT-03:00 Roberto Spadim <[email protected]>: > check lapack lib, i used it some years ago, and it solve linear > equations, at least you don't waste time with 'how to solve linear > equations', if you want to study :) lapack was a nice lib, at least i > used without problems > > 2014-07-08 16:04 GMT-03:00 Roberto Spadim <[email protected]>: >> a1,a2 is what your solve equation function is saving? >> and you want know t1,t2,t3..t130, to understand how much time each >> 'read function' take, that's it? >> >> doing this, what's the next step? this is a start point to select >> what's better? index vs table scan? >> >> >> >> 2014-07-08 15:54 GMT-03:00 Anshu Avinash <[email protected]>: >>> Hi, >>> >>> a1, a2, ..., a130 are coefficients. t1, t2, .., t130 are unknowns. We need >>> 130 linearly independent equations to solve for these variables. We can >>> never get 130 linearly independent equations as some of the coefficients >>> would be 0 every time. Hence, we get an approximate solution by forming an >>> overdetermined system (http://en.wikipedia.org/wiki/Overdetermined_system). >>> Let me know if you have any further doubts. >>> >>> Regards >>> Anshu Avinash >>> >>> >>> On Wed, Jul 9, 2014 at 12:18 AM, Roberto Spadim <[email protected]> >>> wrote: >>>> >>>> ops, linear equation >>>> >>>> 2014-07-08 15:47 GMT-03:00 Roberto Spadim <[email protected]>: >>>> > going back... >>>> > a1t1 + a2t2 + … + a130t130= ttotal >>>> > >>>> > a1, t1... >>>> > >>>> > a1 is something you don't know >>>> > t1 is the coefficients[i]? >>>> > >>>> > it's a first order equation, right? >>>> > >>>> > >>>> > >>>> > 2014-07-08 15:20 GMT-03:00 Anshu Avinash <[email protected]>: >>>> >> Hi, >>>> >> >>>> >> The idea is we know the total time the query took, and how many times >>>> >> an >>>> >> operation was performed. For example, consider the case of 'read_time'. >>>> >> We >>>> >> know how many times an index read took place, but don't know how much >>>> >> time >>>> >> does it take to do an index read. By solving these equations, we are >>>> >> trying >>>> >> to find out time for individual operations. coefficients[i].value is >>>> >> `how >>>> >> many time the operation i took place in a single query.` >>>> >> >>>> >> Hope this clears things up. >>>> >> >>>> >> Regards >>>> >> Anshu Avinash >>>> >> >>>> >> >>>> >> On Tue, Jul 8, 2014 at 10:57 PM, Roberto Spadim <[email protected]> >>>> >> wrote: >>>> >>> >>>> >>> just to understand... >>>> >>> --- the solve_equation part, today only used to save information: >>>> >>> std::ofstream datafile; >>>> >>> char file_name[100]; >>>> >>> my_snprintf(file_name, 100, >>>> >>> "/tmp/mariadb_cost_coefficients_%lu.txt", thread_id); >>>> >>> datafile.open(file_name, std::ios::app); >>>> >>> for(int i=0; i < MAX_CONSTANTS; i++) >>>> >>> datafile << coefficients[i].value << " "; >>>> >>> datafile << total_time << "\n"; >>>> >>> datafile.close(); >>>> >>> ---- >>>> >>> >>>> >>> the idea is: given a query and some coefficients[i].value, you got >>>> >>> total_time need to execute the query >>>> >>> you want to "train" something to tell you how many time the same query >>>> >>> should execute? >>>> >>> or, what's the "x[i]" variables from your system (hardware/hard >>>> >>> disk/etc), and extend this to others queries? >>>> >>> >>>> >>> >>>> >>> 2014-07-08 14:20 GMT-03:00 Roberto Spadim <[email protected]>: >>>> >>> > =] nice >>>> >>> > >>>> >>> > 2014-07-08 14:18 GMT-03:00 Anshu Avinash >>>> >>> > <[email protected]>: >>>> >>> >> Hi all, >>>> >>> >> >>>> >>> >> You can download it here >>>> >>> >> >>>> >>> >> >>>> >>> >> (https://drive.google.com/file/d/0B7NiQb4EbbUVNVJFZ2xkRVR3Ylk/edit?usp=sharing). >>>> >>> >> It is around 26M. I have added the link on blog too. >>>> >>> >> >>>> >>> >> Regards >>>> >>> >> Anshu >>>> >>> >> >>>> >>> >> >>>> >>> >> On Tue, Jul 8, 2014 at 10:38 PM, Roberto Spadim >>>> >>> >> <[email protected]> >>>> >>> >> wrote: >>>> >>> >>> >>>> >>> >>> could you 'display' the dataset you used with octave? >>>> >>> >>> >>>> >>> >>> 2014-07-08 13:55 GMT-03:00 Anshu Avinash >>>> >>> >>> <[email protected]>: >>>> >>> >>> > Hi all, >>>> >>> >>> > >>>> >>> >>> > This week's blog post is at: >>>> >>> >>> > http://igniting.in/gsoc2014/2014/07/08/solving-linear-equations/ >>>> >>> >>> > . >>>> >>> >>> > Sorry >>>> >>> >>> > for >>>> >>> >>> > the delay. >>>> >>> >>> > Suggestions for an approach to solve the system of linear >>>> >>> >>> > equations >>>> >>> >>> > are >>>> >>> >>> > welcome. >>>> >>> >>> > >>>> >>> >>> > Regards >>>> >>> >>> > Anshu Avinash >>>> >>> >>> > >>>> >>> >>> > >>>> >>> >>> > On Mon, Jun 23, 2014 at 7:39 PM, Roberto Spadim >>>> >>> >>> > <[email protected]> >>>> >>> >>> > wrote: >>>> >>> >>> >> >>>> >>> >>> >> " MDEV. " >>>> >>> >>> >> it's nice to put full name (MDEV-350), since google and others >>>> >>> >>> >> search >>>> >>> >>> >> engines help when someone try to find information about mdev >>>> >>> >>> >> 350 >>>> >>> >>> >> >>>> >>> >>> >> text is ok :) >>>> >>> >>> >> >>>> >>> >>> >> 2014-06-23 11:04 GMT-03:00 Anshu Avinash >>>> >>> >>> >> <[email protected]>: >>>> >>> >>> >> > Hi, >>>> >>> >>> >> > >>>> >>> >>> >> > Sorry for the confusion, this is the new link: >>>> >>> >>> >> > http://igniting.in/gsoc2014/2014/06/23/work-before-mid-term/ >>>> >>> >>> >> > Thanks for pointing out. >>>> >>> >>> >> > >>>> >>> >>> >> > Regards >>>> >>> >>> >> > Anshu >>>> >>> >>> >> > >>>> >>> >>> >> > >>>> >>> >>> >> > On Mon, Jun 23, 2014 at 7:32 PM, Roberto Spadim >>>> >>> >>> >> > <[email protected]> >>>> >>> >>> >> > wrote: >>>> >>> >>> >> >> >>>> >>> >>> >> >> "Sorry this page does not exist =(" >>>> >>> >>> >> >> >>>> >>> >>> >> >> 2014-06-23 8:07 GMT-03:00 Anshu Avinash >>>> >>> >>> >> >> <[email protected]>: >>>> >>> >>> >> >> > Hi all, >>>> >>> >>> >> >> > >>>> >>> >>> >> >> > You can find this week's blog entry at: >>>> >>> >>> >> >> > http://igniting.in/2014/06/23/work-before-mid-term/ >>>> >>> >>> >> >> > Suggestions/reviews are welcome. >>>> >>> >>> >> >> > >>>> >>> >>> >> >> > Regards >>>> >>> >>> >> >> > Anshu Avinash >>>> >>> >>> >> >> > >>>> >>> >>> >> >> > >>>> >>> >>> >> >> > On Mon, Jun 9, 2014 at 7:30 PM, Roberto Spadim >>>> >>> >>> >> >> > <[email protected]> >>>> >>> >>> >> >> > wrote: >>>> >>> >>> >> >> >> >>>> >>> >>> >> >> >> Well i wws reading your posts >>>> >>> >>> >> >> >> Do you need big data to test read and scan times? >>>> >>> >>> >> >> >> >>>> >>> >>> >> >> >> Em segunda-feira, 9 de junho de 2014, Anshu Avinash >>>> >>> >>> >> >> >> <[email protected]> escreveu: >>>> >>> >>> >> >> >> >>>> >>> >>> >> >> >>> Hi all, >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> You can find this week's blog entry at >>>> >>> >>> >> >> >>> http://igniting.in/gsoc2014/2014/06/09/more-coding/. I'm >>>> >>> >>> >> >> >>> now >>>> >>> >>> >> >> >>> maintaining the >>>> >>> >>> >> >> >>> code only on github: >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> https://github.com/igniting/server/tree/selfTuningOptimizer. >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> Regards >>>> >>> >>> >> >> >>> Anshu Avinash >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> On Sun, May 25, 2014 at 3:27 PM, Anshu Avinash >>>> >>> >>> >> >> >>> <[email protected]> wrote: >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> Hi all, >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> You can find my this week's blog entry at >>>> >>> >>> >> >> >>> http://igniting.in/gsoc2014/2014/05/25/coding-things-up/ >>>> >>> >>> >> >> >>> . I >>>> >>> >>> >> >> >>> have >>>> >>> >>> >> >> >>> created a >>>> >>> >>> >> >> >>> branch on launchpad for my work: >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> http://bazaar.launchpad.net/~igniting/maria/maria/revision/4211 >>>> >>> >>> >> >> >>> . >>>> >>> >>> >> >> >>> You >>>> >>> >>> >> >> >>> can >>>> >>> >>> >> >> >>> give your suggestions/reviews either on this thread or >>>> >>> >>> >> >> >>> as a >>>> >>> >>> >> >> >>> comment >>>> >>> >>> >> >> >>> on >>>> >>> >>> >> >> >>> the >>>> >>> >>> >> >> >>> blog itself. >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> Regards >>>> >>> >>> >> >> >>> Anshu Avinash >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> On Tue, May 20, 2014 at 1:22 AM, Roberto Spadim >>>> >>> >>> >> >> >>> <[email protected]> >>>> >>> >>> >> >> >>> wrote: >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> wow a big work, congratulation guy, i will read part by >>>> >>> >>> >> >> >>> part >>>> >>> >>> >> >> >>> to >>>> >>> >>> >> >> >>> better >>>> >>> >>> >> >> >>> understand mariadb code >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> 2014-05-19 16:33 GMT-03:00 Anshu Avinash >>>> >>> >>> >> >> >>> <[email protected]>: >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> Hi all, >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> This week's blog entry would get delayed by couple of >>>> >>> >>> >> >> >>> days. >>>> >>> >>> >> >> >>> I >>>> >>> >>> >> >> >>> have >>>> >>> >>> >> >> >>> started coding though and would like to give heads up on >>>> >>> >>> >> >> >>> what >>>> >>> >>> >> >> >>> I'm >>>> >>> >>> >> >> >>> doing. >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> I've looked at the diffs for "Cost model project" of >>>> >>> >>> >> >> >>> mysql: >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/7596 >>>> >>> >>> >> >> >>> and >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/7222 >>>> >>> >>> >> >> >>> . >>>> >>> >>> >> >> >>> These >>>> >>> >>> >> >> >>> give a pretty good idea about what are the hard-coded >>>> >>> >>> >> >> >>> constants >>>> >>> >>> >> >> >>> and >>>> >>> >>> >> >> >>> where >>>> >>> >>> >> >> >>> are they being used. >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> The idea is to multiply "READ_TIME_FACTOR" and >>>> >>> >>> >> >> >>> "SCAN_TIME_FACTOR" >>>> >>> >>> >> >> >>> to >>>> >>> >>> >> >> >>> the >>>> >>> >>> >> >> >>> values returned by read_time() and scan_time() in >>>> >>> >>> >> >> >>> handler.h, >>>> >>> >>> >> >> >>> while >>>> >>> >>> >> >> >>> returning. These values would be read from a table in >>>> >>> >>> >> >> >>> mysql >>>> >>> >>> >> >> >>> db. >>>> >>> >>> >> >> >>> For >>>> >>> >>> >> >> >>> that >>>> >>> >>> >> >> >>> I've looked at sql_statistics.cc. After completing this, >>>> >>> >>> >> >> >>> I'll >>>> >>> >>> >> >> >>> first >>>> >>> >>> >> >> >>> change >>>> >>> >>> >> >> >>> the values of these constants manually and check if the >>>> >>> >>> >> >> >>> better >>>> >>> >>> >> >> >>> or >>>> >>> >>> >> >> >>> worse >>>> >>> >>> >> >> >>> query plans are being selected. I'll first do the last >>>> >>> >>> >> >> >>> step >>>> >>> >>> >> >> >>> manually, >>>> >>> >>> >> >> >>> to >>>> >>> >>> >> >> >>> check if everything is working as expected and later >>>> >>> >>> >> >> >>> automate >>>> >>> >>> >> >> >>> it. >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> Regards >>>> >>> >>> >> >> >>> Anshu >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> On Mon, May 12, 2014 at 11:22 AM, Anshu Avinash >>>> >>> >>> >> >> >>> <[email protected]> wrote: >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> Hi all, >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> You can find my blog entry for this week at >>>> >>> >>> >> >> >>> http://igniting.in/gsoc2014/2014/05/11/first-steps/ . >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> Regards >>>> >>> >>> >> >> >>> Anshu Avinash >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> On Thu, May 8, 2014 at 11:46 PM, Anshu Avinash >>>> >>> >>> >> >> >>> <[email protected]> wrote: >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> Hi all, >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> Sorry for the irregular updates. I had been busy for >>>> >>> >>> >> >> >>> last >>>> >>> >>> >> >> >>> couple >>>> >>> >>> >> >> >>> of >>>> >>> >>> >> >> >>> days >>>> >>> >>> >> >> >>> and might still be busy for 1-2 days more. I would be >>>> >>> >>> >> >> >>> completely >>>> >>> >>> >> >> >>> free >>>> >>> >>> >> >> >>> starting next week, and would be updating my blog weekly >>>> >>> >>> >> >> >>> on >>>> >>> >>> >> >> >>> every >>>> >>> >>> >> >> >>> Monday (so >>>> >>> >>> >> >> >>> 1st update would be on May 12). I would also send the >>>> >>> >>> >> >> >>> link >>>> >>> >>> >> >> >>> of my >>>> >>> >>> >> >> >>> post >>>> >>> >>> >> >> >>> weekly >>>> >>> >>> >> >> >>> on the mailing list. >>>> >>> >>> >> >> >>> >>>> >>> >>> >> >> >>> As discussed on irc, I started to explore the pair of >>>> >>> >>> >> >> >>> constants: >>>> >>> >>> >> >> >>> handler::scan_time() and handler::read_time(). >>>> >>> >>> >> >> >> >>>> >>> >>> >> >> >> >>>> >>> >>> >> >> >> >>>> >>> >>> >> >> >> -- >>>> >>> >>> >> >> >> Roberto Spadim >>>> >>> >>> >> >> >> SPAEmpresarial >>>> >>> >>> >> >> >> Eng. Automação e Controle >>>> >>> >>> >> >> >> >>>> >>> >>> >> >> > >>>> >>> >>> >> >> >>>> >>> >>> >> >> >>>> >>> >>> >> >> >>>> >>> >>> >> >> -- >>>> >>> >>> >> >> Roberto Spadim >>>> >>> >>> >> >> SPAEmpresarial >>>> >>> >>> >> >> Eng. Automação e Controle >>>> >>> >>> >> > >>>> >>> >>> >> > >>>> >>> >>> >> >>>> >>> >>> >> >>>> >>> >>> >> >>>> >>> >>> >> -- >>>> >>> >>> >> Roberto Spadim >>>> >>> >>> >> SPAEmpresarial >>>> >>> >>> >> Eng. Automação e Controle >>>> >>> >>> > >>>> >>> >>> > >>>> >>> >>> >>>> >>> >>> >>>> >>> >>> >>>> >>> >>> -- >>>> >>> >>> Roberto Spadim >>>> >>> >>> SPAEmpresarial >>>> >>> >>> Eng. Automação e Controle >>>> >>> >> >>>> >>> >> >>>> >>> > >>>> >>> > >>>> >>> > >>>> >>> > -- >>>> >>> > Roberto Spadim >>>> >>> > SPAEmpresarial >>>> >>> > Eng. Automação e Controle >>>> >>> >>>> >>> >>>> >>> >>>> >>> -- >>>> >>> Roberto Spadim >>>> >>> SPAEmpresarial >>>> >>> Eng. Automação e Controle >>>> >> >>>> >> >>>> > >>>> > >>>> > >>>> > -- >>>> > Roberto Spadim >>>> > SPAEmpresarial >>>> > Eng. Automação e Controle >>>> >>>> >>>> >>>> -- >>>> Roberto Spadim >>>> SPAEmpresarial >>>> Eng. Automação e Controle >>> >>> >> >> >> >> -- >> Roberto Spadim >> SPAEmpresarial >> Eng. Automação e Controle > > > > -- > Roberto Spadim > SPAEmpresarial > Eng. Automação e Controle -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle _______________________________________________ Mailing list: https://launchpad.net/~maria-developers Post to : [email protected] Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
