Hello Mesos,
I have hacked together an ebuild (gentoo package) to install
mesos-0.20.0. It seems to be working, but I need some generic guidelines to
fully test the mesos package.
I also intend to install it on a small cluster of gentoo machines. Do I
need a distributed file system, such as HDFS for a distributed version
of mesos? ( in other words, a mesos cluster)? If so, what are my
practical choices, CEPH, BTRFS, Gluster or is HDFS required. If
possible, I'm trying to skip over the entire Hadoop environment, as I
have not legacy interests and it seems to not efficient for what's at
the heart of my needs (computations and visual simulations using RDD).
On gentoo, use of binaries is only temporary (transient) until the
sources can be properly assimilated for compiling and installation
control via an ebuild [1]. So I have built the openjdk stack on gentoo,
know as "icedtea." icedtea actually uses open source software tools to
build up the java-jdk from sources. [5]
Eventually, I intend to install Spark, Cassandra, a distributed database
(HyperTable?) and some analytics tools. I hope to use spark on mesos to
solve some very large Finite Element problems [2,[3,4]
So, any other component/supporting codes for this sort of big science
adventure, "mesos+spark" is of the utmost interest to me.
I'm an old unix/bsd/linux hack but some of these newer codes
take me a while to find and figure out the compile-time and run-time
dependencies. When I get all of these (ebuild) modules tested, I'll post
the ebuilds (as Overlays) if anyone is interested.
Your guidance and suggestions are most welcome!
James
[1] http://en.wikipedia.org/wiki/Ebuild
[2] http://en.wikipedia.org/wiki/Finite_element_method
[3] http://www.dune-project.org/
[4] http://www.mcs.anl.gov/petsc/
[5] http://icedtea.classpath.org/wiki/Main_Page
