Re: [OMPI users] Open MPI error MPI_ERR_TRUNCATE: message truncated

2010-07-08 Thread jody 
Hi Jack

100 kbytes are not really big messages sizes. My applications
routinely exchange larger amounts.

The MPI_ERR_TRUNCATE error means that a buffer you provided to
MPI_Recv is too small
to hold the data to be received. Check the size of the data you send
and compare it with the size
of the buffer you passed to MPI_Recv.

As Zhang suggested: try to reduce your code to isolate the offending codes.
Can you create a simple application with two processes exchanging data which has
the MPI_ERR_TRUNCATE problem?

Jody






On Thu, Jul 8, 2010 at 5:39 AM, Jack Bryan <dtustud...@hotmail.com> wrote:
> thanks
> Wat if the master has to send and receive large data package ?
> It has to be splited into multiple parts ?
> This may increase communication overhead.
> I can use MPI_datatype to wrap it up as a specific datatype, which can carry
> the
> data.
> What if the data is very large? 1k bytes or 10 kbytes , 100 kbytes ?
> the master need to collect the same datatype from all workers.
> So, in this way, the master has to set up a data pool to get all data.
> The master's buffer provided by the MPI may not be large enough to do this.
> Are there some other ways to do it ?
> Any help is appreciated.
> thanks
> Jack
> july 7  2010
>
> 
> From: solarbik...@gmail.com
> Date: Wed, 7 Jul 2010 17:32:27 -0700
> To: us...@open-mpi.org
> Subject: Re: [OMPI users] Open MPI error MPI_ERR_TRUNCATE: message truncated
>
> This error typically occurs when the received message is bigger than the
> specified buffer size.  You need to narrow your code down to offending
> receive command to see if this is indeed the case.
>
> On Wed, Jul 7, 2010 at 8:42 AM, Jack Bryan <dtustud...@hotmail.com> wrote:
>
> Dear All:
> I need to transfer some messages from workers master node on MPI cluster
> with Open MPI.
> The number of messages is fixed.
> When I increase the number of worker nodes, i got error:
> --
> terminate called after throwing an instance of
> 'boost::exception_detail::clone_impl<boost::exception_detail::error_info_injector
>>'
>   what():  MPI_Unpack: MPI_ERR_TRUNCATE: message truncated
> [n231:45873] *** Process received signal ***
> [n231:45873] Signal: Aborted (6)
> [n231:45873] Signal code:  (-6)
> [n231:45873] [ 0] /lib64/libpthread.so.0 [0x3c50e0e4c0]
> [n231:45873] [ 1] /lib64/libc.so.6(gsignal+0x35) [0x3c50230215]
> [n231:45873] [ 2] /lib64/libc.so.6(abort+0x110) [0x3c50231cc0]
>
> --
> For 40 workers , it works well.
> But for 50 workers, it got this error.
> The largest message size is not more then 72 bytes.
> Any help is appreciated.
> thanks
> Jack
> July 7 2010
> 
> The New Busy is not the too busy. Combine all your e-mail accounts with
> Hotmail. Get busy.
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
>
>
>
> --
> David Zhang
> University of California, San Diego
>
> 
> The New Busy is not the too busy. Combine all your e-mail accounts with
> Hotmail. Get busy.
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
>

Re: [OMPI users] Open MPI error MPI_ERR_TRUNCATE: message truncated

2010-07-08 Thread Jack Bryan 

thanks
Wat if the master has to send and receive large data package ? 
It has to be splited into multiple parts ? 
This may increase communication overhead. 
I can use MPI_datatype to wrap it up as a specific datatype, which can carry 
the data. What if the data is very large? 1k bytes or 10 kbytes , 100 kbytes ?
the master need to collect the same datatype from all workers. 
So, in this way, the master has to set up a data pool to get all data. 
The master's buffer provided by the MPI may not be large enough to do this. 
Are there some other ways to do it ? 
Any help is appreciated. 
thanks
Jack
july 7  2010 
From: solarbik...@gmail.com
List-Post: users@lists.open-mpi.org
Date: Wed, 7 Jul 2010 17:32:27 -0700
To: us...@open-mpi.org
Subject: Re: [OMPI users] Open MPI error MPI_ERR_TRUNCATE: message truncated

This error typically occurs when the received message is bigger than the 
specified buffer size.  You need to narrow your code down to offending receive 
command to see if this is indeed the case.



On Wed, Jul 7, 2010 at 8:42 AM, Jack Bryan <dtustud...@hotmail.com> wrote:







Dear All:
I need to transfer some messages from workers master node on MPI cluster with 
Open MPI.
The number of messages is fixed. 
When I increase the number of worker nodes, i got error: 


--
terminate called after throwing an instance of 
'boost::exception_detail::clone_impl<boost::exception_detail::error_info_injector
 >'

  what():  MPI_Unpack: MPI_ERR_TRUNCATE: message truncated[n231:45873] *** 
Process received signal ***[n231:45873] Signal: Aborted (6)[n231:45873] Signal 
code:  (-6)[n231:45873] [ 0] /lib64/libpthread.so.0 [0x3c50e0e4c0]

[n231:45873] [ 1] /lib64/libc.so.6(gsignal+0x35) [0x3c50230215][n231:45873] [ 
2] /lib64/libc.so.6(abort+0x110) [0x3c50231cc0]

--


For 40 workers , it works well. 
But for 50 workers, it got this error. 
The largest message size is not more then 72 bytes. 


Any help is appreciated. 
thanks
Jack
July 7 2010   
The New Busy is not the too busy. Combine all your e-mail accounts with 
Hotmail. Get busy.



___

users mailing list

us...@open-mpi.org

http://www.open-mpi.org/mailman/listinfo.cgi/users


-- 
David Zhang
University of California, San Diego
  
_
The New Busy is not the too busy. Combine all your e-mail accounts with Hotmail.
http://www.windowslive.com/campaign/thenewbusy?tile=multiaccount=PID28326::T:WLMTAGL:ON:WL:en-US:WM_HMP:042010_4

Re: [OMPI users] Open MPI error MPI_ERR_TRUNCATE: message truncated

2010-07-07 Thread David Zhang 
This error typically occurs when the received message is bigger than the
specified buffer size.  You need to narrow your code down to offending
receive command to see if this is indeed the case.

On Wed, Jul 7, 2010 at 8:42 AM, Jack Bryan  wrote:

>  Dear All:
>
> I need to transfer some messages from workers master node on MPI cluster
> with Open MPI.
>
> The number of messages is fixed.
>
> When I increase the number of worker nodes, i got error:
>
> --
>
> terminate called after throwing an instance of
> 'boost::exception_detail::clone_impl >'
>   what():  MPI_Unpack: MPI_ERR_TRUNCATE: message truncated
> [n231:45873] *** Process received signal ***
> [n231:45873] Signal: Aborted (6)
> [n231:45873] Signal code:  (-6)
> [n231:45873] [ 0] /lib64/libpthread.so.0 [0x3c50e0e4c0]
> [n231:45873] [ 1] /lib64/libc.so.6(gsignal+0x35) [0x3c50230215]
> [n231:45873] [ 2] /lib64/libc.so.6(abort+0x110) [0x3c50231cc0]
>
>
> --
>
> For 40 workers , it works well.
>
> But for 50 workers, it got this error.
>
> The largest message size is not more then 72 bytes.
>
> Any help is appreciated.
>
> thanks
>
> Jack
>
> July 7 2010
>
> --
> The New Busy is not the too busy. Combine all your e-mail accounts with
> Hotmail. Get 
> busy.
>
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
>



-- 
David Zhang
University of California, San Diego