Yes, I would be interested in hearing how OrangeFS worked for you on EC2. Michael
2011/4/5 Mingliang Liu <[email protected]> > Hi Michael, > > Thank you very much for you useful suggestion. I did meet some problems > when I build the kmod with kernel version 2.6.35.11. Some mistake occurred > saying the member of task_struct not found. I search the source code using > 'grep' to find the members were not useful actually. So I deleted them and > the kernel module could be compiled. I missed other warning too. May some of > them do matter much. > ================================= > #!/bin/bash > sed -i /strategy/d src/kernel/linux-2.6/pvfs2-proc.c > -sed -i /ctl_name/d src/kernel/linux-2.6/pvfs2-proc.c > ================================= > > I tried the latest OrangeFS version, 2.8.4 today. Fortunately, it worked as > I expected. I can now run pvfs2-ping/pvfs2-ls/pvfs2-cp successfully as well > as mount command. The mounted directory can also be accessed via POSIX > style, say, ls/cp/touch etc. I will try to run MPI programs using PVFS2 as > the shared-disk parallel file system. Since my purpose to set up PVFS is to > do some related research, I will report more to you guys if you're > interested in the performance of PVFS on Amazon EC2 cloud platform. > > Many thanks. > > On Tue, Apr 5, 2011 at 6:14 AM, Michael Moore <[email protected]>wrote: > >> Hi Mingliang, >> >> I believe what you're seeing in the dmesg output is related to the kernel >> module failing, it appears to be a backtrace. I'm fairly sure that PVFS >> 2.8.2 won't compile cleanly against a 2.6.35 kernel. I imagine you saw some >> warnings during the make kmod although the build may have "succeeded". The >> latest release of OrangeFS may work although I'm not certain. It will work >> with kernels up to 2.6.34 and support for newer kernels is in the works. >> >> If you can post the output from your make kmod I can tell you for sure but >> I would recommend getting the latest OrangeFS release and posting that >> output. I can work on getting the necessary changes into our development >> branch for you to use. >> >> Thanks, >> Michael >> >> >> On Mon, Apr 4, 2011 at 6:05 PM, Becky Ligon <[email protected]> wrote: >> >>> did you create the /etc/pvfs2tab file? >>> >>> Becky >>> -- >>> Becky Ligon >>> HPC Admin Staff >>> PVFS/OrangeFS Developer >>> Clemson University >>> 864-650-4065 >>> >>> > Hi all, >>> > >>> > I set up the PVFS-2.8.2 with kernel version >>> *2.6.35.11-83.9.amzn1.x86_64. >>> > *I >>> > run the 'make kmod' as well as 'make kmod_install' successfully after I >>> > compiled the pvfs-2.8.2 source tree. Then I tried to add some mount >>> point >>> > to >>> > the /etc/pvfs2tab in another machine. I insmod pvfs2.ko with messages >>> > following. When I run 'lsmod', I saw pvfs2 module was just there. >>> > ==================== >>> > Message from syslogd@ip-10-17-18-247 at Apr 4 18:25:57 ... >>> > kernel:[12187.461117] Oops: 0000 [#1] SMP >>> > Message from syslogd@ip-10-17-18-247 at Apr 4 18:25:57 ... >>> > kernel:[12187.461117] last sysfs file: >>> > /sys/devices/system/cpu/cpu15/cache/index2/shared_cpu_map >>> > Message from syslogd@ip-10-17-18-247 at Apr 4 18:25:57 ... >>> > kernel:[12187.461117] Stack: >>> > Message from syslogd@ip-10-17-18-247 at Apr 4 18:25:57 ... >>> > kernel:[12187.461117] Call Trace: >>> > Message from syslogd@ip-10-17-18-247 at Apr 4 18:25:57 ... >>> > kernel:[12187.461117] Code: e8 c9 fe ff ff c9 83 f8 01 0f 94 c0 0f b6 >>> c0 >>> > c3 >>> > 90 90 90 90 90 90 90 90 90 90 90 90 90 90 55 48 89 e5 41 54 49 89 fc 53 >>> 48 >>> > 89 f3 <48> 83 3e 00 74 24 0f 1f 44 00 00 48 8b 73 18 4c 89 63 20 48 85 >>> > Message from syslogd@ip-10-17-18-247 at Apr 4 18:25:57 ... >>> > kernel:[12187.461117] CR2: 0000000000000003 >>> > =================== >>> > >>> > And the dmesg is as following: >>> > ==================== >>> > [12187.461117] [<ffffffffa027d1ec>] pvfs2_proc_initialize+0x1c/0x30 >>> > [pvfs2] >>> > [12187.461117] [<ffffffffa028c1c5>] pvfs2_init+0x1c5/0x23c [pvfs2] >>> > [12187.461117] [<ffffffffa028c000>] ? pvfs2_init+0x0/0x23c [pvfs2] >>> > [12187.461117] [<ffffffff81002047>] do_one_initcall+0x37/0x1a0 >>> > [12187.461117] [<ffffffff810818a2>] sys_init_module+0xb2/0x200 >>> > [12187.461117] [<ffffffff8100ae82>] system_call_fastpath+0x16/0x1b >>> > [12187.461117] Code: e8 c9 fe ff ff c9 83 f8 01 0f 94 c0 0f b6 c0 c3 >>> 90 90 >>> > 90 90 90 90 90 90 90 90 90 90 90 90 55 48 89 e5 41 54 49 89 fc 53 48 89 >>> f3 >>> > <48> 83 3e 00 74 24 0f 1f 44 00 00 48 8b 73 18 4c 89 63 20 48 85 >>> > [12187.461117] RIP [<ffffffff810583ad>] sysctl_set_parent+0xd/0x40 >>> > [12187.461117] RSP <ffff8805a7051dc8> >>> > [12187.461117] CR2: 0000000000000003 >>> > [12187.621903] ---[ end trace 9c2a971e5cf0a5c0 ]--- >>> > [12187.628366] serial8250: too much work for irq4 >>> > ===================== >>> > >>> > After that, I started the server/client respectively. Then I tried the >>> > pvfs2-ping and it worked as expected. Then I tried in the command line >>> to >>> > mount it for POSIX-style use. But the mount command failed with error >>> > message "mount: unknown filesystem type 'pvfs2'". I tried twice on two >>> > different machines with no luck. I followed the quick start guide step >>> by >>> > step so that there should be something out of it I missed. >>> > >>> > Any idea will be highly appreciated. >>> > >>> > Best Regards. >>> > -- >>> > Mingliang Liu (刘明亮 in Chinese) >>> > >>> > PACMAN Group, Dept. of Computer Science & Technology >>> > Tsinghua University, Beijing 100084, China >>> > Tel: +86-136 1126 4251 (Mobile) >>> > Email: [email protected] >>> > _______________________________________________ >>> > Pvfs2-users mailing list >>> > [email protected] >>> > http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users >>> > >>> >>> >>> _______________________________________________ >>> Pvfs2-users mailing list >>> [email protected] >>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users >>> >> >> > > > -- > Mingliang Liu (刘明亮 in Chinese) > > PACMAN Group, Dept. of Computer Science & Technology > Tsinghua University, Beijing 100084, China > Tel: +86-136 1126 4251 (Mobile) > Email: [email protected] >
_______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
