i didn't read the code yet, but some min/max problems can add restrictions about variables, for example you could set that variables are >=0 must check but well that's a nice step guy :) a nice work :)
2014-08-04 13:31 GMT-03:00 Anshu Avinash <[email protected]>: > Hi all, > > Here is a blog post describing my progress so far: > http://igniting.in/gsoc2014/2014/08/04/progress-so-far/ > > Comments and suggestions are welcome. > > Regards > Anshu Avinash > > > On Wed, Jul 9, 2014 at 1:14 AM, Roberto Spadim <[email protected]> > wrote: > >> please include the output (solutions.txt) link too, to check what happened >> >> 2014-07-08 16:24 GMT-03:00 Roberto Spadim <[email protected]>: >> > http://www.netlib.org/lapack/lapacke.html >> > a C api to lapack >> > >> > 2014-07-08 16:23 GMT-03:00 Roberto Spadim <[email protected]>: >> >> check lapack lib, i used it some years ago, and it solve linear >> >> equations, at least you don't waste time with 'how to solve linear >> >> equations', if you want to study :) lapack was a nice lib, at least i >> >> used without problems >> >> >> >> 2014-07-08 16:04 GMT-03:00 Roberto Spadim <[email protected]>: >> >>> a1,a2 is what your solve equation function is saving? >> >>> and you want know t1,t2,t3..t130, to understand how much time each >> >>> 'read function' take, that's it? >> >>> >> >>> doing this, what's the next step? this is a start point to select >> >>> what's better? index vs table scan? >> >>> >> >>> >> >>> >> >>> 2014-07-08 15:54 GMT-03:00 Anshu Avinash <[email protected]>: >> >>>> Hi, >> >>>> >> >>>> a1, a2, ..., a130 are coefficients. t1, t2, .., t130 are unknowns. >> We need >> >>>> 130 linearly independent equations to solve for these variables. We >> can >> >>>> never get 130 linearly independent equations as some of the >> coefficients >> >>>> would be 0 every time. Hence, we get an approximate solution by >> forming an >> >>>> overdetermined system ( >> http://en.wikipedia.org/wiki/Overdetermined_system). >> >>>> Let me know if you have any further doubts. >> >>>> >> >>>> Regards >> >>>> Anshu Avinash >> >>>> >> >>>> >> >>>> On Wed, Jul 9, 2014 at 12:18 AM, Roberto Spadim < >> [email protected]> >> >>>> wrote: >> >>>>> >> >>>>> ops, linear equation >> >>>>> >> >>>>> 2014-07-08 15:47 GMT-03:00 Roberto Spadim <[email protected]>: >> >>>>> > going back... >> >>>>> > a1t1 + a2t2 + … + a130t130= ttotal >> >>>>> > >> >>>>> > a1, t1... >> >>>>> > >> >>>>> > a1 is something you don't know >> >>>>> > t1 is the coefficients[i]? >> >>>>> > >> >>>>> > it's a first order equation, right? >> >>>>> > >> >>>>> > >> >>>>> > >> >>>>> > 2014-07-08 15:20 GMT-03:00 Anshu Avinash < >> [email protected]>: >> >>>>> >> Hi, >> >>>>> >> >> >>>>> >> The idea is we know the total time the query took, and how many >> times >> >>>>> >> an >> >>>>> >> operation was performed. For example, consider the case of >> 'read_time'. >> >>>>> >> We >> >>>>> >> know how many times an index read took place, but don't know how >> much >> >>>>> >> time >> >>>>> >> does it take to do an index read. By solving these equations, we >> are >> >>>>> >> trying >> >>>>> >> to find out time for individual operations. >> coefficients[i].value is >> >>>>> >> `how >> >>>>> >> many time the operation i took place in a single query.` >> >>>>> >> >> >>>>> >> Hope this clears things up. >> >>>>> >> >> >>>>> >> Regards >> >>>>> >> Anshu Avinash >> >>>>> >> >> >>>>> >> >> >>>>> >> On Tue, Jul 8, 2014 at 10:57 PM, Roberto Spadim < >> [email protected]> >> >>>>> >> wrote: >> >>>>> >>> >> >>>>> >>> just to understand... >> >>>>> >>> --- the solve_equation part, today only used to save >> information: >> >>>>> >>> std::ofstream datafile; >> >>>>> >>> char file_name[100]; >> >>>>> >>> my_snprintf(file_name, 100, >> >>>>> >>> "/tmp/mariadb_cost_coefficients_%lu.txt", thread_id); >> >>>>> >>> datafile.open(file_name, std::ios::app); >> >>>>> >>> for(int i=0; i < MAX_CONSTANTS; i++) >> >>>>> >>> datafile << coefficients[i].value << " "; >> >>>>> >>> datafile << total_time << "\n"; >> >>>>> >>> datafile.close(); >> >>>>> >>> ---- >> >>>>> >>> >> >>>>> >>> the idea is: given a query and some coefficients[i].value, you >> got >> >>>>> >>> total_time need to execute the query >> >>>>> >>> you want to "train" something to tell you how many time the >> same query >> >>>>> >>> should execute? >> >>>>> >>> or, what's the "x[i]" variables from your system (hardware/hard >> >>>>> >>> disk/etc), and extend this to others queries? >> >>>>> >>> >> >>>>> >>> >> >>>>> >>> 2014-07-08 14:20 GMT-03:00 Roberto Spadim < >> [email protected]>: >> >>>>> >>> > =] nice >> >>>>> >>> > >> >>>>> >>> > 2014-07-08 14:18 GMT-03:00 Anshu Avinash >> >>>>> >>> > <[email protected]>: >> >>>>> >>> >> Hi all, >> >>>>> >>> >> >> >>>>> >>> >> You can download it here >> >>>>> >>> >> >> >>>>> >>> >> >> >>>>> >>> >> ( >> https://drive.google.com/file/d/0B7NiQb4EbbUVNVJFZ2xkRVR3Ylk/edit?usp=sharing >> ). >> >>>>> >>> >> It is around 26M. I have added the link on blog too. >> >>>>> >>> >> >> >>>>> >>> >> Regards >> >>>>> >>> >> Anshu >> >>>>> >>> >> >> >>>>> >>> >> >> >>>>> >>> >> On Tue, Jul 8, 2014 at 10:38 PM, Roberto Spadim >> >>>>> >>> >> <[email protected]> >> >>>>> >>> >> wrote: >> >>>>> >>> >>> >> >>>>> >>> >>> could you 'display' the dataset you used with octave? >> >>>>> >>> >>> >> >>>>> >>> >>> 2014-07-08 13:55 GMT-03:00 Anshu Avinash >> >>>>> >>> >>> <[email protected]>: >> >>>>> >>> >>> > Hi all, >> >>>>> >>> >>> > >> >>>>> >>> >>> > This week's blog post is at: >> >>>>> >>> >>> > >> http://igniting.in/gsoc2014/2014/07/08/solving-linear-equations/ >> >>>>> >>> >>> > . >> >>>>> >>> >>> > Sorry >> >>>>> >>> >>> > for >> >>>>> >>> >>> > the delay. >> >>>>> >>> >>> > Suggestions for an approach to solve the system of linear >> >>>>> >>> >>> > equations >> >>>>> >>> >>> > are >> >>>>> >>> >>> > welcome. >> >>>>> >>> >>> > >> >>>>> >>> >>> > Regards >> >>>>> >>> >>> > Anshu Avinash >> >>>>> >>> >>> > >> >>>>> >>> >>> > >> >>>>> >>> >>> > On Mon, Jun 23, 2014 at 7:39 PM, Roberto Spadim >> >>>>> >>> >>> > <[email protected]> >> >>>>> >>> >>> > wrote: >> >>>>> >>> >>> >> >> >>>>> >>> >>> >> " MDEV. " >> >>>>> >>> >>> >> it's nice to put full name (MDEV-350), since google and >> others >> >>>>> >>> >>> >> search >> >>>>> >>> >>> >> engines help when someone try to find information about >> mdev >> >>>>> >>> >>> >> 350 >> >>>>> >>> >>> >> >> >>>>> >>> >>> >> text is ok :) >> >>>>> >>> >>> >> >> >>>>> >>> >>> >> 2014-06-23 11:04 GMT-03:00 Anshu Avinash >> >>>>> >>> >>> >> <[email protected]>: >> >>>>> >>> >>> >> > Hi, >> >>>>> >>> >>> >> > >> >>>>> >>> >>> >> > Sorry for the confusion, this is the new link: >> >>>>> >>> >>> >> > >> http://igniting.in/gsoc2014/2014/06/23/work-before-mid-term/ >> >>>>> >>> >>> >> > Thanks for pointing out. >> >>>>> >>> >>> >> > >> >>>>> >>> >>> >> > Regards >> >>>>> >>> >>> >> > Anshu >> >>>>> >>> >>> >> > >> >>>>> >>> >>> >> > >> >>>>> >>> >>> >> > On Mon, Jun 23, 2014 at 7:32 PM, Roberto Spadim >> >>>>> >>> >>> >> > <[email protected]> >> >>>>> >>> >>> >> > wrote: >> >>>>> >>> >>> >> >> >> >>>>> >>> >>> >> >> "Sorry this page does not exist =(" >> >>>>> >>> >>> >> >> >> >>>>> >>> >>> >> >> 2014-06-23 8:07 GMT-03:00 Anshu Avinash >> >>>>> >>> >>> >> >> <[email protected]>: >> >>>>> >>> >>> >> >> > Hi all, >> >>>>> >>> >>> >> >> > >> >>>>> >>> >>> >> >> > You can find this week's blog entry at: >> >>>>> >>> >>> >> >> > http://igniting.in/2014/06/23/work-before-mid-term/ >> >>>>> >>> >>> >> >> > Suggestions/reviews are welcome. >> >>>>> >>> >>> >> >> > >> >>>>> >>> >>> >> >> > Regards >> >>>>> >>> >>> >> >> > Anshu Avinash >> >>>>> >>> >>> >> >> > >> >>>>> >>> >>> >> >> > >> >>>>> >>> >>> >> >> > On Mon, Jun 9, 2014 at 7:30 PM, Roberto Spadim >> >>>>> >>> >>> >> >> > <[email protected]> >> >>>>> >>> >>> >> >> > wrote: >> >>>>> >>> >>> >> >> >> >> >>>>> >>> >>> >> >> >> Well i wws reading your posts >> >>>>> >>> >>> >> >> >> Do you need big data to test read and scan times? >> >>>>> >>> >>> >> >> >> >> >>>>> >>> >>> >> >> >> Em segunda-feira, 9 de junho de 2014, Anshu Avinash >> >>>>> >>> >>> >> >> >> <[email protected]> escreveu: >> >>>>> >>> >>> >> >> >> >> >>>>> >>> >>> >> >> >>> Hi all, >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> You can find this week's blog entry at >> >>>>> >>> >>> >> >> >>> >> http://igniting.in/gsoc2014/2014/06/09/more-coding/. I'm >> >>>>> >>> >>> >> >> >>> now >> >>>>> >>> >>> >> >> >>> maintaining the >> >>>>> >>> >>> >> >> >>> code only on github: >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> >> https://github.com/igniting/server/tree/selfTuningOptimizer. >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> Regards >> >>>>> >>> >>> >> >> >>> Anshu Avinash >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> On Sun, May 25, 2014 at 3:27 PM, Anshu Avinash >> >>>>> >>> >>> >> >> >>> <[email protected]> wrote: >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> Hi all, >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> You can find my this week's blog entry at >> >>>>> >>> >>> >> >> >>> >> http://igniting.in/gsoc2014/2014/05/25/coding-things-up/ >> >>>>> >>> >>> >> >> >>> . I >> >>>>> >>> >>> >> >> >>> have >> >>>>> >>> >>> >> >> >>> created a >> >>>>> >>> >>> >> >> >>> branch on launchpad for my work: >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> >> http://bazaar.launchpad.net/~igniting/maria/maria/revision/4211 >> >>>>> >>> >>> >> >> >>> . >> >>>>> >>> >>> >> >> >>> You >> >>>>> >>> >>> >> >> >>> can >> >>>>> >>> >>> >> >> >>> give your suggestions/reviews either on this >> thread or >> >>>>> >>> >>> >> >> >>> as a >> >>>>> >>> >>> >> >> >>> comment >> >>>>> >>> >>> >> >> >>> on >> >>>>> >>> >>> >> >> >>> the >> >>>>> >>> >>> >> >> >>> blog itself. >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> Regards >> >>>>> >>> >>> >> >> >>> Anshu Avinash >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> On Tue, May 20, 2014 at 1:22 AM, Roberto Spadim >> >>>>> >>> >>> >> >> >>> <[email protected]> >> >>>>> >>> >>> >> >> >>> wrote: >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> wow a big work, congratulation guy, i will read >> part by >> >>>>> >>> >>> >> >> >>> part >> >>>>> >>> >>> >> >> >>> to >> >>>>> >>> >>> >> >> >>> better >> >>>>> >>> >>> >> >> >>> understand mariadb code >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> 2014-05-19 16:33 GMT-03:00 Anshu Avinash >> >>>>> >>> >>> >> >> >>> <[email protected]>: >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> Hi all, >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> This week's blog entry would get delayed by >> couple of >> >>>>> >>> >>> >> >> >>> days. >> >>>>> >>> >>> >> >> >>> I >> >>>>> >>> >>> >> >> >>> have >> >>>>> >>> >>> >> >> >>> started coding though and would like to give >> heads up on >> >>>>> >>> >>> >> >> >>> what >> >>>>> >>> >>> >> >> >>> I'm >> >>>>> >>> >>> >> >> >>> doing. >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> I've looked at the diffs for "Cost model project" >> of >> >>>>> >>> >>> >> >> >>> mysql: >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> >> http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/7596 >> >>>>> >>> >>> >> >> >>> and >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> >> http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/7222 . >> >>>>> >>> >>> >> >> >>> These >> >>>>> >>> >>> >> >> >>> give a pretty good idea about what are the >> hard-coded >> >>>>> >>> >>> >> >> >>> constants >> >>>>> >>> >>> >> >> >>> and >> >>>>> >>> >>> >> >> >>> where >> >>>>> >>> >>> >> >> >>> are they being used. >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> The idea is to multiply "READ_TIME_FACTOR" and >> >>>>> >>> >>> >> >> >>> "SCAN_TIME_FACTOR" >> >>>>> >>> >>> >> >> >>> to >> >>>>> >>> >>> >> >> >>> the >> >>>>> >>> >>> >> >> >>> values returned by read_time() and scan_time() in >> >>>>> >>> >>> >> >> >>> handler.h, >> >>>>> >>> >>> >> >> >>> while >> >>>>> >>> >>> >> >> >>> returning. These values would be read from a >> table in >> >>>>> >>> >>> >> >> >>> mysql >> >>>>> >>> >>> >> >> >>> db. >> >>>>> >>> >>> >> >> >>> For >> >>>>> >>> >>> >> >> >>> that >> >>>>> >>> >>> >> >> >>> I've looked at sql_statistics.cc. After >> completing this, >> >>>>> >>> >>> >> >> >>> I'll >> >>>>> >>> >>> >> >> >>> first >> >>>>> >>> >>> >> >> >>> change >> >>>>> >>> >>> >> >> >>> the values of these constants manually and check >> if the >> >>>>> >>> >>> >> >> >>> better >> >>>>> >>> >>> >> >> >>> or >> >>>>> >>> >>> >> >> >>> worse >> >>>>> >>> >>> >> >> >>> query plans are being selected. I'll first do the >> last >> >>>>> >>> >>> >> >> >>> step >> >>>>> >>> >>> >> >> >>> manually, >> >>>>> >>> >>> >> >> >>> to >> >>>>> >>> >>> >> >> >>> check if everything is working as expected and >> later >> >>>>> >>> >>> >> >> >>> automate >> >>>>> >>> >>> >> >> >>> it. >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> Regards >> >>>>> >>> >>> >> >> >>> Anshu >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> On Mon, May 12, 2014 at 11:22 AM, Anshu Avinash >> >>>>> >>> >>> >> >> >>> <[email protected]> wrote: >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> Hi all, >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> You can find my blog entry for this week at >> >>>>> >>> >>> >> >> >>> >> http://igniting.in/gsoc2014/2014/05/11/first-steps/ . >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> Regards >> >>>>> >>> >>> >> >> >>> Anshu Avinash >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> On Thu, May 8, 2014 at 11:46 PM, Anshu Avinash >> >>>>> >>> >>> >> >> >>> <[email protected]> wrote: >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> Hi all, >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> Sorry for the irregular updates. I had been busy >> for >> >>>>> >>> >>> >> >> >>> last >> >>>>> >>> >>> >> >> >>> couple >> >>>>> >>> >>> >> >> >>> of >> >>>>> >>> >>> >> >> >>> days >> >>>>> >>> >>> >> >> >>> and might still be busy for 1-2 days more. I >> would be >> >>>>> >>> >>> >> >> >>> completely >> >>>>> >>> >>> >> >> >>> free >> >>>>> >>> >>> >> >> >>> starting next week, and would be updating my blog >> weekly >> >>>>> >>> >>> >> >> >>> on >> >>>>> >>> >>> >> >> >>> every >> >>>>> >>> >>> >> >> >>> Monday (so >> >>>>> >>> >>> >> >> >>> 1st update would be on May 12). I would also send >> the >> >>>>> >>> >>> >> >> >>> link >> >>>>> >>> >>> >> >> >>> of my >> >>>>> >>> >>> >> >> >>> post >> >>>>> >>> >>> >> >> >>> weekly >> >>>>> >>> >>> >> >> >>> on the mailing list. >> >>>>> >>> >>> >> >> >>> >> >>>>> >>> >>> >> >> >>> As discussed on irc, I started to explore the >> pair of >> >>>>> >>> >>> >> >> >>> constants: >> >>>>> >>> >>> >> >> >>> handler::scan_time() and handler::read_time(). >> >>>>> >>> >>> >> >> >> >> >>>>> >>> >>> >> >> >> >> >>>>> >>> >>> >> >> >> >> >>>>> >>> >>> >> >> >> -- >> >>>>> >>> >>> >> >> >> Roberto Spadim >> >>>>> >>> >>> >> >> >> SPAEmpresarial >> >>>>> >>> >>> >> >> >> Eng. Automação e Controle >> >>>>> >>> >>> >> >> >> >> >>>>> >>> >>> >> >> > >> >>>>> >>> >>> >> >> >> >>>>> >>> >>> >> >> >> >>>>> >>> >>> >> >> >> >>>>> >>> >>> >> >> -- >> >>>>> >>> >>> >> >> Roberto Spadim >> >>>>> >>> >>> >> >> SPAEmpresarial >> >>>>> >>> >>> >> >> Eng. Automação e Controle >> >>>>> >>> >>> >> > >> >>>>> >>> >>> >> > >> >>>>> >>> >>> >> >> >>>>> >>> >>> >> >> >>>>> >>> >>> >> >> >>>>> >>> >>> >> -- >> >>>>> >>> >>> >> Roberto Spadim >> >>>>> >>> >>> >> SPAEmpresarial >> >>>>> >>> >>> >> Eng. Automação e Controle >> >>>>> >>> >>> > >> >>>>> >>> >>> > >> >>>>> >>> >>> >> >>>>> >>> >>> >> >>>>> >>> >>> >> >>>>> >>> >>> -- >> >>>>> >>> >>> Roberto Spadim >> >>>>> >>> >>> SPAEmpresarial >> >>>>> >>> >>> Eng. Automação e Controle >> >>>>> >>> >> >> >>>>> >>> >> >> >>>>> >>> > >> >>>>> >>> > >> >>>>> >>> > >> >>>>> >>> > -- >> >>>>> >>> > Roberto Spadim >> >>>>> >>> > SPAEmpresarial >> >>>>> >>> > Eng. Automação e Controle >> >>>>> >>> >> >>>>> >>> >> >>>>> >>> >> >>>>> >>> -- >> >>>>> >>> Roberto Spadim >> >>>>> >>> SPAEmpresarial >> >>>>> >>> Eng. Automação e Controle >> >>>>> >> >> >>>>> >> >> >>>>> > >> >>>>> > >> >>>>> > >> >>>>> > -- >> >>>>> > Roberto Spadim >> >>>>> > SPAEmpresarial >> >>>>> > Eng. Automação e Controle >> >>>>> >> >>>>> >> >>>>> >> >>>>> -- >> >>>>> Roberto Spadim >> >>>>> SPAEmpresarial >> >>>>> Eng. Automação e Controle >> >>>> >> >>>> >> >>> >> >>> >> >>> >> >>> -- >> >>> Roberto Spadim >> >>> SPAEmpresarial >> >>> Eng. Automação e Controle >> >> >> >> >> >> >> >> -- >> >> Roberto Spadim >> >> SPAEmpresarial >> >> Eng. Automação e Controle >> > >> > >> > >> > -- >> > Roberto Spadim >> > SPAEmpresarial >> > Eng. Automação e Controle >> >> >> >> -- >> Roberto Spadim >> SPAEmpresarial >> Eng. Automação e Controle >> > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle
_______________________________________________ Mailing list: https://launchpad.net/~maria-developers Post to : [email protected] Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
