Hi List,
I think the Joey question is a good topic. However, is very important know very
well where can Bewoulf model help in this case. The Bewoulf cluster concept is
based on a software framework (e.g. PVM, MPI, etc.) which allow the development
of application which can execute, using these frameworks, its many internal
activities in a parallel form, at the cluster machines. Itīs very important
understand that the application needs be parallelized, in a code level, to
explore the cluster processing.
I think the beowulf cluster is more applied to provide a parallel environment
for the database server (here Mysql) and not for the database clients. I donīt
know a project related to Mysql implementation using some type of this APIs
(MPI, PVM, etc.) to explore the parallel processing from a beowulf cluster
environment.
So, looking for the Joey issue, I think beowulf isnīt applied here. IMHO, techs
such SMP backend machines plus a kind of load balancer frontend could be more
applied.
In case Joey is thinking to work on a project to implement a data mining system
using mysql as database, I think the use of neural networks, due to its
parallel organization, could be a good choice to explore the beowulf
environment.
Regards,
RMJ.
Citando Joey Kelly <[EMAIL PROTECTED]>:
> Gary,
>
> Thanks for your response.
>
> Basically, what we are doing is buidling a huge database that will
> hold a lot of different info on each of our customers. I can't tell
> you
> what we do for a living, but basically we want to find out (for
> instance)
> how many of our customers used our product (the green one, not
> the blue or
> red one) last month, and travelled to Tennesee while using it. We
> might be
> able to sell this info to our vendors so they can make a better
> product
> next year. We have well over 100,000 customers. We will probably
> need to
> run other types of queries against the data next month, and I have 2
> programmers to write the queries.
>
> What kind of algorithms my coders will construct is up to them (I'm
> just the admin).
>
> I do know that beowulfen are great number crunchers, and that a
> huge number of selects might not run faster on a cluster than one
> one huge machine because of the I/O bottlenecks between
> machines. We are planning on doing what we can to compensate
> for this. That said, what kid of experiences have you and others
> had with mysql and clusters?
>
> --Joey
>
> From: "Gary Huntress" <[EMAIL PROTECTED]>
> To: "Joey Kelly" <[EMAIL PROTECTED]>,
> <[EMAIL PROTECTED]>
> Subject: Re: beowulfen and mysql
> Date sent: Sun, 15 Jul 2001 21:19:02 -0400
>
> > First, lets make sure we're all talking about the same thing. A
> general
> > definition of data mining would be "the automated extraction of
> predictive
> > information from large databases". Automated implies some sort of
> agent,
> > and by its very nature the predictions are statistical (hence the
> large data
> > sets). Most agents that I have seen could be classified as decision
> tree,
> > neural network, or genetic algorithm.
> >
> > Note that data mining is not considered to be data warehousing, ad
> hoc
> > querying, OLTP or visualization.
> >
> > Are you trying to build some sort of predictive model? Perhaps you
> can
> > describe it a bit further. In general, once you pick an algorithm
> or
> > approach you would have to build an application layer above your
> query
> > layer. I imagine you would do that in C, for speed.
> >
> > You probably want to read about MySQL replication here
> >
> http://www.mysql.com/documentation/mysql/bychapter/manual_Replication.html#R
> > eplication
> >
> > Now, regarding Beowulf clusters. They are defined as (by the people
> that
> > created it, Donald Becker and company) solely a computational cluster
> and
> > not something geared toward data mining. You certainly can learn
> some
> > great lessons from their architecture (channel bonded ethernet or
> myrinet)
> > but don't expect them to answer any questions in the database arena!
> >
> > Regards,
> > Gary "SuperID" Huntress
> > =======================================================
> > FreeSQL.org offering free database hosting to developers
> > Visit http://www.freesql.org
> >
> >
> >
> >
> >
> > ----- Original Message -----
> > From: "Joey Kelly" <[EMAIL PROTECTED]>
> > To: <[EMAIL PROTECTED]>
> > Sent: Sunday, July 15, 2001 8:26 PM
> > Subject: beowulfen and mysql
> >
> >
> > > Howdy.
> > >
> > > My company needs to implement a data mining setup. I am
> > > building a cluster using dual athlons and perhaps firewire instead
> of
> > > 100baseTX.
> > >
> > > I need to find out as much as I can from those who have done
> > > mysql on beowulfen. Please contact me at [EMAIL PROTECTED]
> > >
> > > Thanks :)
> > >
> > > +++
> > >
> > > Joey Kelly
> > > /Minister of the Gospel | Computer Networking Consultant/
> > > http://nolalinuxcoop.dhs.org/~jkelly/home/
> > >
> > > "Experience hath shewn, that even under the best forms [of
> government]
> > those entrusted with power have, in time, and by slow op
> > > erations, perverted it into tyranny." - Thomas Jefferson
> > >
> > >
> > >
> ---------------------------------------------------------------------
> > > Before posting, please check:
> > > http://www.mysql.com/manual.php (the manual)
> > > http://lists.mysql.com/ (the list archive)
> > >
> > > To request this thread, e-mail <[EMAIL PROTECTED]>
> > > To unsubscribe, e-mail
> > <[EMAIL PROTECTED]>
> > > Trouble unsubscribing? Try:
> http://lists.mysql.com/php/unsubscribe.php
> > >
> >
>
>
>
> +++
>
> Joey Kelly
> /Minister of the Gospel | Computer Networking Consultant/
> http://nolalinuxcoop.dhs.org/~jkelly/home/
>
> "Experience hath shewn, that even under the best forms [of government]
> those entrusted with power have, in time, and by slow op
> erations, perverted it into tyranny." - Thomas Jefferson
>
>
> ---------------------------------------------------------------------
> Before posting, please check:
> http://www.mysql.com/manual.php (the manual)
> http://lists.mysql.com/ (the list archive)
>
> To request this thread, e-mail <[EMAIL PROTECTED]>
> To unsubscribe, e-mail
> <[EMAIL PROTECTED]>
> Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
>
> _______________________________________________
> db mailing list
> [EMAIL PROTECTED]
> http://listas.bsb.conectiva/mailman/listinfo/db
>
---------------------------------------------------------------------
Before posting, please check:
http://www.mysql.com/manual.php (the manual)
http://lists.mysql.com/ (the list archive)
To request this thread, e-mail <[EMAIL PROTECTED]>
To unsubscribe, e-mail <[EMAIL PROTECTED]>
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php
