C-Sharifi Cluster Engine: The Second Success Story on "Kernel-Level Paradigm" for Distributed Computing Support
Contrary to two school of thoughts in providing system software support for distributed computation that advocate either the development of a whole new distributed operating system (like Mach), or the development of library-based or patch-based middleware on top of existing operating systems (like MPI, Kerrighed and Mosix), Dr. Mohsen Sharifi hypothesized another school of thought as his thesis in 1986 that believes all distributed systems software requirements and supports can be and must be built at the Kernel Level of existing operating systems; requirements like Ease of Programming, Simplicity, Efficiency, Accessibility, etc which may be coined as Usability. Although the latter belief was hard to realize, a sample byproduct called DIPC was built purely based on this thesis and openly announced to the Linux community worldwide in 1993. This was admired for being able to provide necessary supports for distributed communication at the Kernel Level of Linux for the first time in the world, and for providing Ease of Programming as a consequence of being realized at the Kernel Level. However, it was criticized at the same time as being inefficient. This did not force the school to trade Ease of Programming for Efficiency but instead tried hard to achieve efficiency, alongside ease of programming and simplicity, without defecting the school that advocates the provision of all needs at the kernel level. The result of this effort is now manifested in the C-Sharifi Cluster Engine. C-Sharifi is a cost effective distributed system software engine in support of high performance computing by clusters of off-the-shelf computers. It is wholly implemented in Kernel, and as a consequence of following this school, it has Ease of Programming, Ease of Clustering, Simplicity, and it can be configured to fit as best as possible to the efficiency requirements of applications that need high performance. It supports both distributed shared memory and message passing styles, it is built in Linux, and its cost/performance ratio in some scientific applications (like meteorology and cryptanalysis) has shown to be far better than non-kernel-based solutions and engines (like MPI, Kerrighed and Mosix). Best Regard ~Ehsan Mousavi C-Sharifi Development Team -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of [EMAIL PROTECTED] Sent: Monday, December 03, 2007 10:38 AM To: [email protected] Subject: Oscar-devel Digest, Vol 19, Issue 4 Send Oscar-devel mailing list submissions to [email protected] To subscribe or unsubscribe via the World Wide Web, visit https://lists.sourceforge.net/lists/listinfo/oscar-devel or, via email, send a message with subject or body 'help' to [EMAIL PROTECTED] You can reach the person managing the list at [EMAIL PROTECTED] When replying, please edit your Subject line so it is more specific than "Re: Contents of Oscar-devel digest..." Today's Topics: 1. Re: [Sisuite-devel] New systemimager-4.0.1.svn4352.kexecfix+rsync3pre6.bli version (Andrea Righi) 2. Re: [Sisuite-devel] New systemimager-4.0.1.svn4352.kexecfix+rsync3pre6.bli version (Bernard Li) 3. Re: opkgc 0.4 (Bernard Li) 4. Re: opkgc 0.4 (Bernard Li) 5. Re: opkgc 0.4 (Allan Menezes) 6. DB issues with crispy 5.1 branch on Fedora 8 x86 (Bernard Li) 7. Re: DB issues with crispy 5.1 branch on Fedora 8 x86 (Allan Menezes) ---------------------------------------------------------------------- Message: 1 Date: Sun, 2 Dec 2007 21:40:22 +0100 (MET) From: Andrea Righi <[EMAIL PROTECTED]> Subject: Re: [Oscar-devel] [Sisuite-devel] New systemimager-4.0.1.svn4352.kexecfix+rsync3pre6.bli version To: Bernard Li <[EMAIL PROTECTED]> Cc: sisuite-dev <[EMAIL PROTECTED]>, [email protected] Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=us-ascii Bernard Li wrote: > Hi Andrea: > > On 12/2/07, Andrea Righi <[EMAIL PROTECTED]> wrote: > >> don't use the current SI trunk, it needs more testing and debugging activities, >> because a lot of core-packages have been updated. >> >> The next SI stable release will be based on the 4.0.x branch: >> http://svn.systemimager.org/listing.php?repname=systemimager&path=%2Fbranche s%2F4.0.x%2F&rev=0&sc=0 >> >> So, better to use this branch for a while... > > I see -- should I backport both my recent fixes to trunk to branch-4.0.x? > > http://www.systemimager.org:8000/trac.systemimager.org/changeset/4353 > http://www.systemimager.org:8000/trac.systemimager.org/changeset/4354 > Sounds good. Do it please. -Andrea ------------------------------ Message: 2 Date: Sun, 2 Dec 2007 13:30:33 -0800 From: "Bernard Li" <[EMAIL PROTECTED]> Subject: Re: [Oscar-devel] [Sisuite-devel] New systemimager-4.0.1.svn4352.kexecfix+rsync3pre6.bli version To: [EMAIL PROTECTED] Cc: sisuite-dev <[EMAIL PROTECTED]>, [email protected] Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=ISO-8859-1 Done. BTW, the latest SystemImager snapshot from branch-4.0.x is now available here: http://therealms.org/oss/systemimager/snapshots/ Cheers, Bernard On 12/2/07, Andrea Righi <[EMAIL PROTECTED]> wrote: > Bernard Li wrote: > > Hi Andrea: > > > > On 12/2/07, Andrea Righi <[EMAIL PROTECTED]> wrote: > > > >> don't use the current SI trunk, it needs more testing and debugging activities, > >> because a lot of core-packages have been updated. > >> > >> The next SI stable release will be based on the 4.0.x branch: > >> http://svn.systemimager.org/listing.php?repname=systemimager&path=%2Fbranche s%2F4.0.x%2F&rev=0&sc=0 > >> > >> So, better to use this branch for a while... > > > > I see -- should I backport both my recent fixes to trunk to branch-4.0.x? > > > > http://www.systemimager.org:8000/trac.systemimager.org/changeset/4353 > > http://www.systemimager.org:8000/trac.systemimager.org/changeset/4354 > > > > Sounds good. Do it please. > > -Andrea > ------------------------------ Message: 3 Date: Sun, 2 Dec 2007 15:04:41 -0800 From: "Bernard Li" <[EMAIL PROTECTED]> Subject: Re: [Oscar-devel] opkgc 0.4 To: [email protected] Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=ISO-8859-1 Hi Jean: On 11/13/07, Jean Parpaillon <[EMAIL PROTECTED]> wrote: > Tarball is available on GForge: > http://oscar.gforge.inria.fr/downloads/opkgc-0.4.tar.gz I added the URL to our wiki so that people can find the latest release: http://svn.oscar.openclustergroup.org/trac/oscar/wiki/opkg_opkgc > Debs are on the OSCAR apt repository > RPMs : I have no RPM-like machine currently. spec file is ready on svn > (http://svn.oscar.openclustergroup.org/svn/oscar/pkgsrc/opkgc/packages/rpm/t runk/). > Could someone build it ? I'll build the RPMs for Fedora 8 x86 now. Cheers, Bernard ------------------------------ Message: 4 Date: Sun, 2 Dec 2007 15:11:11 -0800 From: "Bernard Li" <[EMAIL PROTECTED]> Subject: Re: [Oscar-devel] opkgc 0.4 To: [email protected] Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=ISO-8859-1 Hi Jean: On 12/2/07, Bernard Li <[EMAIL PROTECTED]> wrote: > > Debs are on the OSCAR apt repository > > RPMs : I have no RPM-like machine currently. spec file is ready on svn > > (http://svn.oscar.openclustergroup.org/svn/oscar/pkgsrc/opkgc/packages/rpm/t runk/). > > Could someone build it ? > > I'll build the RPMs for Fedora 8 x86 now. Can you please move the spec file to the root of the opkgc tree? This way the release tarball will include the spec file so I could do rpmbuild -ta opkgc-0.4.tar.gz to build the RPM. Likewise I would suggest you also check in the debian/ directory to opkgc root. Thanks, Bernard ------------------------------ Message: 5 Date: Sun, 02 Dec 2007 18:38:57 -0500 From: Allan Menezes <[EMAIL PROTECTED]> Subject: Re: [Oscar-devel] opkgc 0.4 To: [email protected] Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset="us-ascii" Hi Bernard, Cool! Thank you very much. I have a cluster going on fc8 using Eric Focht instructions and i had already uploaded some rpms i had built for the platform. I added two quad core nodes two days ago using oscar_wizard -manage and it worked like a charm! Thanks to all of you, your creative efforts seem to be paying off. Cheers! Allan Menezes Bernard Li wrote: >Hi Jean: > >On 11/13/07, Jean Parpaillon <[EMAIL PROTECTED]> wrote: > > > >>Tarball is available on GForge: >>http://oscar.gforge.inria.fr/downloads/opkgc-0.4.tar.gz >> >> > >I added the URL to our wiki so that people can find the latest release: > >http://svn.oscar.openclustergroup.org/trac/oscar/wiki/opkg_opkgc > > > >>Debs are on the OSCAR apt repository >>RPMs : I have no RPM-like machine currently. spec file is ready on svn >>(http://svn.oscar.openclustergroup.org/svn/oscar/pkgsrc/opkgc/packages/rpm /trunk/). >>Could someone build it ? >> >> > >I'll build the RPMs for Fedora 8 x86 now. > >Cheers, > >Bernard > >------------------------------------------------------------------------- >SF.Net email is sponsored by: The Future of Linux Business White Paper >from Novell. From the desktop to the data center, Linux is going >mainstream. Let it simplify your IT future. >http://altfarm.mediaplex.com/ad/ck/8857-50307-18918-4 >_______________________________________________ >Oscar-devel mailing list >[email protected] >https://lists.sourceforge.net/lists/listinfo/oscar-devel > > > > -------------- next part -------------- An HTML attachment was scrubbed... ------------------------------ Message: 6 Date: Sun, 2 Dec 2007 22:26:26 -0800 From: "Bernard Li" <[EMAIL PROTECTED]> Subject: [Oscar-devel] DB issues with crispy 5.1 branch on Fedora 8 x86 To: [email protected] Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=ISO-8859-1 Got the following error message when trying to install crispy 5.1 branch on Fedora 8 x86: Initializing package set <Default> DBD::mysql::db do failed: Cannot add or update a child row: a foreign key constraint fails (`oscar/Group_Packages`, CONSTRAINT `Group_Packages_ibfk_1` FOREIGN KEY (`package`) REFERENCES `Packages` (`package`) ON DELETE CASCADE) at /opt/oscar/lib/OSCAR/oda.pm line 733. DB_DEBUG>./wizard_prep: ====> in Database::do_update SQL : INSERT INTO Group_Packages (group_name, package, selected) VALUES ('Default', 'apitest', '1') Error message: Failed to update Group_Packages table in database <oscar>: Cannot add or update a child row: a foreign key constraint fails (`oscar/Group_Packages`, CONSTRAINT `Group_Packages_ibfk_1` FOREIGN KEY (`package`) REFERENCES `Packages` (`package`) ON DELETE CASCADE) at /opt/oscar/lib/OSCAR/oda.pm line 739. ./wizard_prep: SQL command that failed was: <INSERT INTO Group_Packages (group_name, package, selected) VALUES ('Default', 'apitest', '1')> at /opt/oscar/lib/OSCAR/oda.pm line 739. DB_DEBUG>./wizard_prep: ====>Failed to insert values via << INSERT INTO Group_Packages (group_name, package, selected) VALUES ('Default', 'apitest', '1') >> at /opt/oscar/lib/OSCAR/Database.pm line 1681. Oscar Wizard preparation script failed to complete at ./install_cluster line 279. Any ideas? Cheers, Bernard ------------------------------ Message: 7 Date: Mon, 03 Dec 2007 02:07:26 -0500 From: Allan Menezes <[EMAIL PROTECTED]> Subject: Re: [Oscar-devel] DB issues with crispy 5.1 branch on Fedora 8 x86 To: [email protected] Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset="iso-8859-1" Bernard Li wrote: >Got the following error message when trying to install crispy 5.1 >branch on Fedora 8 x86: > >Initializing package set <Default> >DBD::mysql::db do failed: Cannot add or update a child row: a foreign >key constraint fails (`oscar/Group_Packages`, CONSTRAINT >`Group_Packages_ibfk_1` FOREIGN KEY (`package`) REFERENCES `Packages` >(`package`) ON DELETE CASCADE) at /opt/oscar/lib/OSCAR/oda.pm line >733. >DB_DEBUG>./wizard_prep: >====> in Database::do_update SQL : INSERT INTO Group_Packages >(group_name, package, selected) VALUES ('Default', 'apitest', '1') >Error message: Failed to update Group_Packages table in database ><oscar>: Cannot add or update a child row: a foreign key constraint >fails (`oscar/Group_Packages`, CONSTRAINT `Group_Packages_ibfk_1` >FOREIGN KEY (`package`) REFERENCES `Packages` (`package`) ON DELETE >CASCADE) at /opt/oscar/lib/OSCAR/oda.pm line 739. >./wizard_prep: SQL command that failed was: <INSERT INTO >Group_Packages (group_name, package, selected) VALUES ('Default', >'apitest', '1')> at /opt/oscar/lib/OSCAR/oda.pm line 739. >DB_DEBUG>./wizard_prep: >====>Failed to insert values via << INSERT INTO Group_Packages >(group_name, package, selected) VALUES ('Default', 'apitest', '1') >> >at /opt/oscar/lib/OSCAR/Database.pm line 1681. >Oscar Wizard preparation script failed to complete at >./install_cluster line 279. > >Any ideas? > >Cheers, > >Bernard > >------------------------------------------------------------------------- >SF.Net email is sponsored by: The Future of Linux Business White Paper >from Novell. From the desktop to the data center, Linux is going >mainstream. Let it simplify your IT future. >http://altfarm.mediaplex.com/ad/ck/8857-50307-18918-4 >_______________________________________________ >Oscar-devel mailing list >[email protected] >https://lists.sourceforge.net/lists/listinfo/oscar-devel > > > > Hi Bernard, I wrote the following email before to Eirch: And please find fc8.tar attached Allan Hi Erich, Success,finally! I created anew server image after adding opium in the software selection gui, built the serrver and client images with gui and deployed my cluster. I now have a Fedora 8 OSCAR CRispy 5.1 cluster of 8 nodes and can ssh back and forth as non root and root user! I also used UYOK. It needs the package csh from yum. and some others but with some hiccups it still works for fc8! THe latest and the greatest Fedora distro! OSCAR CRISPY 5.1 still needs a lot of work to get a seamless install in half hour! I have new fc-8-x86_64.xml files ans fc-8-x86_64.rpmlist files in /opt/crispy_5.1/share/package_sets/Default and /opt/crispy_5.1/oscarsamples. I included in my last email the additional files i had created for fc8 but there are still some to be created and labelled them against you list as -- done and --not done. Did you get it. I uploaded the new file to the dir fc-8_x86_64-oscar51 by accident instead of fc-8-x86_64-oscar51! PLease find attached the tar fc8.tar containg the new rpmlist for fc8 and xml config for fc8 which works for me. Also i used a local distro in /tftpboot/distro copied from the Packages dir of fc8 x86_64 dvd called fc-8-x86_64. For some reason naming it /tftpboot/distro/fedora-8-x86_64 causes a problem with PackageSmart.pm line 128. BUt if i move with the linux mv command the fedora-8-x86_64 dir to fc-8-x86_64 the problem goes away. Thank you very much and waiting for your feedback. Tell me if you are going to add fc8 x86_64 support to CRISPY 5.1! Cheers, Allan Menezes -------------- next part -------------- A non-text attachment was scrubbed... Name: fc8.tar Type: application/x-tar Size: 10240 bytes Desc: not available ------------------------------ ------------------------------------------------------------------------- SF.Net email is sponsored by: The Future of Linux Business White Paper from Novell. From the desktop to the data center, Linux is going mainstream. Let it simplify your IT future. http://altfarm.mediaplex.com/ad/ck/8857-50307-18918-4 ------------------------------ _______________________________________________ Oscar-devel mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/oscar-devel End of Oscar-devel Digest, Vol 19, Issue 4 ****************************************** ------------------------------------------------------------------------- SF.Net email is sponsored by: The Future of Linux Business White Paper from Novell. From the desktop to the data center, Linux is going mainstream. Let it simplify your IT future. http://altfarm.mediaplex.com/ad/ck/8857-50307-18918-4 _______________________________________________ Oscar-devel mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/oscar-devel
