Christos, I committed a change earlier today into CVS Orange-Branch that, in limited testing, resolved the issues I was seeing on the ARM device I have. With help from some other folks here, we tracked it down to alignment issues with memory passed back from Berkeley (namely that it's not aligned). As a miscellaneous hint, to make debugging easier echo 5 into /proc/cpu/alignment so you get a SIGBUS instead of mucked up data when making unaligned accesses. There may be some more cases to track down but with these initial changes you should be able to get up and running. If not, or if you run into more issues, please let us know.
Sorry for the delay in getting a fix for this issue! Thanks, Michael On Tue, Jul 19, 2011 at 5:47 PM, Kyle Schochenmaier <[email protected]>wrote: > This may be a really dumb question... > Your data server only has 32MB of ram (assuming this is some NAS or > router+attached storage device?) .. is that enough to run your linux kernel > as well as then open up all of the necessary buffers, etc for a pvfs2 > server? Do we know what a typical tcp-ip footprint is (8MB?) ? > > Kyle Schochenmaier > > > > On Tue, Jul 19, 2011 at 4:43 PM, Phil Carns <[email protected]> wrote: > >> ** >> Can you try running the same pvfs2-cp on the arm machine as well? That >> may indicate if there is a fundamental problem with the daemon on that node, >> or if there is an error with the network encoding between x86_64 and arm. >> >> -Phil >> >> >> On 07/12/2011 07:17 AM, Michael Moore wrote: >> >> I don't have any ideas off-hand, you may be right that it's an >> architecture issue. Can you re-run the test with EventLogging set to >> 'bstream, trove' in the server configuration and send those logs? >> >> Michael >> >> On Tue, Jul 12, 2011 at 4:03 AM, Christos Filippidis < >> [email protected]> wrote: >> >>> Hi, >>> >>> I am trying to configure orangefs for testing to the following system: >>> >>> Metadata server /client: >>> Centos 5 :Linux 2.6.18-194.17.4.el5 #1 SMP Mon Oct 25 15:50:53 EDT 2010 >>> x86_64 x86_64 x86_64 GNU/Linux >>> >>> Data server: >>> Debian Lenny :Linux 2.6.17.14 #16 PREEMPT Sat Feb 5 12:45:55 UTC 2011 >>> armv5tejl GNU/Linux >>> >>> Data server configuration options: >>> >>> ./configure --prefix=/shares/internal/PUBLIC/orange >>> >>> Metadata server /client configuration options: >>> >>> ./configure --prefix=/state/partition1/orange >>> --with-kernel=/usr/src/kernels/2.6.18-194.17.4.el5-x86_64/ >>> >>> The compilation and installation was successful. >>> "bin/pvfs2-ping -m /mnt/orange" was also successful. >>> >>> But every time i try to "pvfs2-cp" a file i am receiving a >>> "trove_write_callback_fn: I/O error occurred" at the data server side(the >>> same happens with pvfs-2.8.2) >>> >>> I tried to reconfigure orangefs with many different options but nothing >>> seams to works. >>> I also tried "alt-aio" "null-aio" "directio" but nothing happened. >>> >>> It seams that something strange happens with the data server(ARM >>> processor - 200MHZ,32MB RAM)because both orangefs and pvfs2 works fine when >>> i am using as data servers intel or AMD processors. >>> >>> Do you have any idea what is wrong ? >>> i really need to install orangefs at this ARM processor. >>> Thanks in advance >>> Christos >>> >>> ps: i send you some log files from the data server >>> >>> alt-aio >>> -------- >>> PVFS2 Server version 2.8.4-orangefs starting. >>> [E 07/12/2011 07:38:30] trove_write_callback_fn: I/O error occurred >>> [E 07/12/2011 07:38:30] handle_io_error: flow proto error cleanup started >>> on 0x154a88: No such file or directory >>> [E 07/12/2011 07:38:30] handle_io_error: flow proto 0x154a88 canceled 0 >>> operations, will clean up. >>> [E 07/12/2011 07:38:30] handle_io_error: flow proto 0x154a88 error >>> cleanup finished: No such file or directory >>> >>> >>> directio >>> ----------- >>> PVFS2 Server version 2.8.4-orangefs starting. >>> [E 07/12/2011 07:56:39] dbpf_bstream_direct_write_op_svc: failed to get >>> dspace attr for bstream: (error=-1073742082) >>> [E 07/12/2011 07:57:09] job_time_mgr_expire: job time out: cancelling >>> flow operation, job_id: 505. >>> [E 07/12/2011 07:57:09] fp_multiqueue_cancel: flow proto cancel called on >>> 0x113f00 >>> [E 07/12/2011 07:57:09] fp_multiqueue_cancel: I/O error occurred >>> [E 07/12/2011 07:57:09] handle_io_error: flow proto error cleanup started >>> on 0x113f00: Operation cancelled (possibly due to timeout) >>> >>> >>> >>> bin/pvfs2-ping -m /mnt/orange/ >>> >>> (1) Parsing tab file... >>> >>> (2) Initializing system interface... >>> >>> (3) Initializing each file system found in tab file: /etc/fstab... >>> >>> PVFS2 servers: tcp://nas-0-1:3334 >>> Storage name: pvfs2-fs >>> Local mount point: /mnt/orange >>> /mnt/orange: Ok >>> >>> (4) Searching for /mnt/orange/ in pvfstab... >>> >>> PVFS2 servers: tcp://nas-0-1:3334 >>> Storage name: pvfs2-fs >>> Local mount point: /mnt/orange >>> >>> meta servers: >>> tcp://ikaros:3334 >>> >>> data servers: >>> tcp://nas-0-1:3334 >>> >>> (5) Verifying that all servers are responding... >>> >>> meta servers: >>> tcp://ikaros:3334 Ok >>> >>> data servers: >>> tcp://nas-0-1:3334 Ok >>> >>> (6) Verifying that fsid 883136527 is acceptable to all servers... >>> >>> Ok; all servers understand fs_id 883136527 >>> >>> (7) Verifying that root handle is owned by one server... >>> >>> Root handle: 1048576 >>> Ok; root handle is owned by exactly one server. >>> >>> ============================================================= >>> >>> The PVFS2 filesystem at /mnt/orange/ appears to be correctly configured. >>> >>> >>> >>> -- >>> Christos Filippidis >>> Institute of Nuclear Physics >>> National Center for Scientific Research "Demokritos" >>> Patr. Grigoriou & Neapoleos Str >>> 153 10 Agia Paraskevi Attikis >>> Athens, Greece >>> Tel:+30 2106503425 >>> >>> http://www.inp.demokritos.gr/~filippidisx/ >>> _______________________________________________ >>> Pvfs2-users mailing list >>> [email protected] >>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users >>> >> >> >> _______________________________________________ >> Pvfs2-users mailing >> [email protected]http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users >> >> >> >> _______________________________________________ >> Pvfs2-users mailing list >> [email protected] >> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users >> >> > > _______________________________________________ > Pvfs2-users mailing list > [email protected] > http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users > >
_______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
