Bonjour,

J'ai passé massif sur mon programme, je joins le .ps généré.
Je travaille sur Linux avec TSP.0.8.3 avec patch bug 19706
Je suis en train d'essayer de créer un programme qui ferait seulement du tsp 
(même utilisation que le code de mon projet qui pose problème) et voir si le pb 
se reproduit; dans ce cas, je vous ferai parvenir ce code...

A+

Virginie Alaux (55-24)


-----Original Message-----
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Eric Noulard
Sent: Monday, July 30, 2007 1:59 PM
To: Transport Sample Protocol development list
Subject: Re: [Tsp-devel] Increasing memory while sampling


Le 30/07/07, Frederik Deweerdt<[EMAIL PROTECTED]> a écrit :
> On Mon, Jul 30, 2007 at 11:04:25AM +0200, Eric Noulard wrote:
> > D'après ce que je comprends la conso mémoire l'ascii_writer
> > ne souffre pas d'inflation mais est maximum peu après request_sample_init
> > puis tombe à 0 en fin d'exécution.
> >
> > Fred, peux-tu confirmer/corriger mon analyse?

> Hmm, c'est bien ce que donne massif: il y a enormement d'allocs qui se
> passent au dÃ(c)but du programme, puis celle-ci cessent parla suite.

> Est-ce qu'on pourrait avoir le problème suivant:
> 1) RINGBUF_PTR_INIT alloue beaucoup de mÃmoire en dÃ(c)but de programme:
> cf: http://www.mail-archive.com/[email protected]/msg00480.html
> - massif rapporte une alloc de 1Go!

Je vais ajouter de quoi STRACER les allocations des RINGBUFs
d'ailleurs je pense qu'on pourrait avantageusement remplacer
tous les malloc/calloc par un tsp_alloc de façon à pouvoir
maîtriser/monitorer toutes les allocations dynamiques via une seule
fonction de la lib TSP.

> 2) L'allocation marche, mais les pages ne sont utilisÃ(c)es effectivement
> qu'au fur et a mesure, du coup on a l'impression que les allocations se
> font de manière continue et a un rythme elevÃ(c).

C'est possible.
Je m'en vais ajouter un mlockall histoire de voir si ça me pète à la tronche.

> 3) On n'aurait pas de problème de fuite mÃ(c)moire mais juste un ring
> buffer trop gros en comparaison avec ce dont on a rÃ(c)ellement besoin?

Oui, possible.
J'avais déjà limité la taille de certains buffers à 2 Mo.
https://savannah.nongnu.org/bugs/index.php?16629

Je vais voir ce que je peux faire pour le ringbuf.
Ce qui est étonnant c'est qu'un deuxième tsp_sample_request_init
stoppe le phénomène.

Mais bon ce n'est peut-être qu'un épiphénomène.

-- 
Erk


_______________________________________________
Tsp-devel mailing list
[email protected]
http://lists.nongnu.org/mailman/listinfo/tsp-devel



Ce courriel (incluant ses eventuelles pieces jointes) peut contenir des 
informations confidentielles et/ou protegees ou dont la diffusion est 
restreinte. Si vous avez recu ce courriel par erreur, vous ne devez ni le 
copier, ni l'utiliser, ni en divulguer le contenu a quiconque. Merci d'en 
avertir immediatement l'expediteur et d'effacer ce courriel de votre systeme. 
Astrium decline toute responsabilite en cas de corruption par virus, 
d'alteration ou de falsification de ce courriel lors de sa transmission par 
voie electronique.

This email (including any attachments) may contain confidential and/or 
privileged information or information otherwise protected from disclosure. If 
you are not the intended recipient, please notify the sender immediately, do 
not copy this message or any attachments and do not use it for any purpose or 
disclose its content to any person, but delete this message and any attachments 
from your system. Astrium disclaims any and all liability if this email 
transmission was virus corrupted, altered or falsified.
---------------------------------------------------------------------
Astrium SAS (393 341 516 RCS Paris) - Siege social: 6 rue Laurent Pichat, 75016 
Paris, France
Command: /OC/EIF/src/EIF_TSP/OCEIF_TSP_Handler/src/OCEIF_TSP_Handler -F nofork 
-n OCEIF_TSP -N TSP_SCOE1_ARC -g Grp1 -G 1 -l -t -u SCOE1 ARC

== 0 ===========================
Heap allocation functions accounted for 97.4% of measured spacetime

Called from:
  67.2% : 0x432F5B1: TSP_consumer_request_sample_init (tsp_consumer.c:1149)

  13.4% : 0x4329064: TSP_data_receiver_create (tsp_data_receiver.c:131)

   9.6% : 0x469E67C: ACE_New_Allocator::malloc(unsigned) 
(Malloc_Allocator.cpp:118)

   0.8% : 0x4698191: ACE_Local_Memory_Pool::acquire(unsigned, unsigned&) 
(Local_Memory_Pool.cpp:58)

   0.5% : 0x49E9712: IC_PoolMem::allocate(unsigned) (IC_PoolMem.cpp:55)

  and 496 other insignificant places

== 1 ===========================
Context accounted for 67.2% of measured spacetime
  0x432F5B1: TSP_consumer_request_sample_init (tsp_consumer.c:1149)

Called from:
  67.2% : 0x808698D: OCEIF_TSP_ScoeComm::acquisitionStart() 
(OCEIF_TSP_ScoeComm.cpp:433)

---------------------------------
Context accounted for 13.4% of measured spacetime
  0x4329064: TSP_data_receiver_create (tsp_data_receiver.c:131)

Called from:
  13.4% : 0x432F579: TSP_consumer_request_sample_init (tsp_consumer.c:1142)

---------------------------------
Context accounted for  9.6% of measured spacetime
  0x469E67C: ACE_New_Allocator::malloc(unsigned) (Malloc_Allocator.cpp:118)

Called from:
   7.0% : 0x48A5C8F: ACE_Hash_Map_Manager_Ex<ACE_String_Base<char>, 
TAO_Root_POA*, ACE_Hash<ACE_String_Base<char> >, 
ACE_Equal_To<ACE_String_Base<char> >, ACE_Null_Mutex>::create_buckets(unsigned) 
(in /opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)

  and 48 other insignificant places

---------------------------------
Context accounted for  0.8% of measured spacetime
  0x4698191: ACE_Local_Memory_Pool::acquire(unsigned, unsigned&) 
(Local_Memory_Pool.cpp:58)

Called from:
   0.7% : 0x46980A9: ACE_Local_Memory_Pool::init_acquire(unsigned, unsigned&, 
int&) (Local_Memory_Pool.cpp:47)

  and 1 other insignificant place

---------------------------------
Context accounted for  0.5% of measured spacetime
  0x49E9712: IC_PoolMem::allocate(unsigned) (IC_PoolMem.cpp:55)

Called from:
  27 insignificant places

== 2 ===========================
Context accounted for 67.2% of measured spacetime
  0x432F5B1: TSP_consumer_request_sample_init (tsp_consumer.c:1149)
  0x808698D: OCEIF_TSP_ScoeComm::acquisitionStart() (OCEIF_TSP_ScoeComm.cpp:433)

Called from:
  67.2% : 0x8078C5B: OCEIF_TSP_ConnectionManager::acquisitionStart() 
(OCEIF_TSP_ConnectionManager.cpp:659)

---------------------------------
Context accounted for 13.4% of measured spacetime
  0x4329064: TSP_data_receiver_create (tsp_data_receiver.c:131)
  0x432F579: TSP_consumer_request_sample_init (tsp_consumer.c:1142)

Called from:
  13.4% : 0x808698D: OCEIF_TSP_ScoeComm::acquisitionStart() 
(OCEIF_TSP_ScoeComm.cpp:433)

---------------------------------
Context accounted for  7.0% of measured spacetime
  0x469E67C: ACE_New_Allocator::malloc(unsigned) (Malloc_Allocator.cpp:118)
  0x48A5C8F: ACE_Hash_Map_Manager_Ex<ACE_String_Base<char>, TAO_Root_POA*, 
ACE_Hash<ACE_String_Base<char> >, ACE_Equal_To<ACE_String_Base<char> >, 
ACE_Null_Mutex>::create_buckets(unsigned) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)

Called from:
   7.0% : 0x48A5D38: ACE_Hash_Map_Manager_Ex<ACE_String_Base<char>, 
TAO_Root_POA*, ACE_Hash<ACE_String_Base<char> >, 
ACE_Equal_To<ACE_String_Base<char> >, ACE_Null_Mutex>::open(unsigned, 
ACE_Allocator*) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)

---------------------------------
Context accounted for  0.7% of measured spacetime
  0x4698191: ACE_Local_Memory_Pool::acquire(unsigned, unsigned&) 
(Local_Memory_Pool.cpp:58)
  0x46980A9: ACE_Local_Memory_Pool::init_acquire(unsigned, unsigned&, int&) 
(Local_Memory_Pool.cpp:47)

Called from:
   0.7% : 0x44BE159: ACE_Malloc_T<ACE_Local_Memory_Pool, ACE_Thread_Mutex, 
ACE_Control_Block>::open() (in /opt/COTS/ACE_wrappers/TAO/tao/libTAO.so.1.5.0)

== 3 ===========================
Context accounted for 67.2% of measured spacetime
  0x432F5B1: TSP_consumer_request_sample_init (tsp_consumer.c:1149)
  0x808698D: OCEIF_TSP_ScoeComm::acquisitionStart() (OCEIF_TSP_ScoeComm.cpp:433)
  0x8078C5B: OCEIF_TSP_ConnectionManager::acquisitionStart() 
(OCEIF_TSP_ConnectionManager.cpp:659)

Called from:
  67.2% : 0x805E915: OCEIF_TSP_Idl_i::acquisitionStart() 
(OCEIF_TSP_Idl_i.cpp:283)

---------------------------------
Context accounted for 13.4% of measured spacetime
  0x4329064: TSP_data_receiver_create (tsp_data_receiver.c:131)
  0x432F579: TSP_consumer_request_sample_init (tsp_consumer.c:1142)
  0x808698D: OCEIF_TSP_ScoeComm::acquisitionStart() (OCEIF_TSP_ScoeComm.cpp:433)

Called from:
  13.4% : 0x8078C5B: OCEIF_TSP_ConnectionManager::acquisitionStart() 
(OCEIF_TSP_ConnectionManager.cpp:659)

---------------------------------
Context accounted for  7.0% of measured spacetime
  0x469E67C: ACE_New_Allocator::malloc(unsigned) (Malloc_Allocator.cpp:118)
  0x48A5C8F: ACE_Hash_Map_Manager_Ex<ACE_String_Base<char>, TAO_Root_POA*, 
ACE_Hash<ACE_String_Base<char> >, ACE_Equal_To<ACE_String_Base<char> >, 
ACE_Null_Mutex>::create_buckets(unsigned) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)
  0x48A5D38: ACE_Hash_Map_Manager_Ex<ACE_String_Base<char>, TAO_Root_POA*, 
ACE_Hash<ACE_String_Base<char> >, ACE_Equal_To<ACE_String_Base<char> >, 
ACE_Null_Mutex>::open(unsigned, ACE_Allocator*) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)

Called from:
   5.3% : 0x48A42F4: TAO_Root_POA::TAO_Root_POA(ACE_String_Base<char> const&, 
TAO_POA_Manager&, TAO_POA_Policy_Set const&, TAO_Root_POA*, ACE_Lock&, 
ACE_Thread_Mutex&, TAO_ORB_Core&, TAO_Object_Adapter*) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)

   0.8% : 0x48A3D95: TAO_Root_POA::TAO_Root_POA(ACE_String_Base<char> const&, 
TAO_POA_Manager&, TAO_POA_Policy_Set const&, TAO_Root_POA*, ACE_Lock&, 
ACE_Thread_Mutex&, TAO_ORB_Core&, TAO_Object_Adapter*) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)

---------------------------------
Context accounted for  0.7% of measured spacetime
  0x4698191: ACE_Local_Memory_Pool::acquire(unsigned, unsigned&) 
(Local_Memory_Pool.cpp:58)
  0x46980A9: ACE_Local_Memory_Pool::init_acquire(unsigned, unsigned&, int&) 
(Local_Memory_Pool.cpp:47)
  0x44BE159: ACE_Malloc_T<ACE_Local_Memory_Pool, ACE_Thread_Mutex, 
ACE_Control_Block>::open() (in /opt/COTS/ACE_wrappers/TAO/tao/libTAO.so.1.5.0)

Called from:
   0.7% : 0x44BE313: ACE_Malloc_T<ACE_Local_Memory_Pool, ACE_Thread_Mutex, 
ACE_Control_Block>::ACE_Malloc_T(char const*) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO.so.1.5.0)

== 4 ===========================
Context accounted for 67.2% of measured spacetime
  0x432F5B1: TSP_consumer_request_sample_init (tsp_consumer.c:1149)
  0x808698D: OCEIF_TSP_ScoeComm::acquisitionStart() (OCEIF_TSP_ScoeComm.cpp:433)
  0x8078C5B: OCEIF_TSP_ConnectionManager::acquisitionStart() 
(OCEIF_TSP_ConnectionManager.cpp:659)
  0x805E915: OCEIF_TSP_Idl_i::acquisitionStart() (OCEIF_TSP_Idl_i.cpp:283)

Called from:
  67.2% : 0x8067BD5: acquisitionStart_OCEIF_TSP_Idl::execute() 
(OCEIF_TSP_IdlS.cpp:559)

---------------------------------
Context accounted for 13.4% of measured spacetime
  0x4329064: TSP_data_receiver_create (tsp_data_receiver.c:131)
  0x432F579: TSP_consumer_request_sample_init (tsp_consumer.c:1142)
  0x808698D: OCEIF_TSP_ScoeComm::acquisitionStart() (OCEIF_TSP_ScoeComm.cpp:433)
  0x8078C5B: OCEIF_TSP_ConnectionManager::acquisitionStart() 
(OCEIF_TSP_ConnectionManager.cpp:659)

Called from:
  13.4% : 0x805E915: OCEIF_TSP_Idl_i::acquisitionStart() 
(OCEIF_TSP_Idl_i.cpp:283)

---------------------------------
Context accounted for  5.3% of measured spacetime
  0x469E67C: ACE_New_Allocator::malloc(unsigned) (Malloc_Allocator.cpp:118)
  0x48A5C8F: ACE_Hash_Map_Manager_Ex<ACE_String_Base<char>, TAO_Root_POA*, 
ACE_Hash<ACE_String_Base<char> >, ACE_Equal_To<ACE_String_Base<char> >, 
ACE_Null_Mutex>::create_buckets(unsigned) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)
  0x48A5D38: ACE_Hash_Map_Manager_Ex<ACE_String_Base<char>, TAO_Root_POA*, 
ACE_Hash<ACE_String_Base<char> >, ACE_Equal_To<ACE_String_Base<char> >, 
ACE_Null_Mutex>::open(unsigned, ACE_Allocator*) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)
  0x48A42F4: TAO_Root_POA::TAO_Root_POA(ACE_String_Base<char> const&, 
TAO_POA_Manager&, TAO_POA_Policy_Set const&, TAO_Root_POA*, ACE_Lock&, 
ACE_Thread_Mutex&, TAO_ORB_Core&, TAO_Object_Adapter*) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)

Called from:
   5.3% : 0x489A0D1: TAO_Regular_POA::TAO_Regular_POA(ACE_String_Base<char> 
const&, TAO_POA_Manager&, TAO_POA_Policy_Set const&, TAO_Root_POA*, ACE_Lock&, 
ACE_Thread_Mutex&, TAO_ORB_Core&, TAO_Object_Adapter*) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)

---------------------------------
Context accounted for  0.8% of measured spacetime
  0x469E67C: ACE_New_Allocator::malloc(unsigned) (Malloc_Allocator.cpp:118)
  0x48A5C8F: ACE_Hash_Map_Manager_Ex<ACE_String_Base<char>, TAO_Root_POA*, 
ACE_Hash<ACE_String_Base<char> >, ACE_Equal_To<ACE_String_Base<char> >, 
ACE_Null_Mutex>::create_buckets(unsigned) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)
  0x48A5D38: ACE_Hash_Map_Manager_Ex<ACE_String_Base<char>, TAO_Root_POA*, 
ACE_Hash<ACE_String_Base<char> >, ACE_Equal_To<ACE_String_Base<char> >, 
ACE_Null_Mutex>::open(unsigned, ACE_Allocator*) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)
  0x48A3D95: TAO_Root_POA::TAO_Root_POA(ACE_String_Base<char> const&, 
TAO_POA_Manager&, TAO_POA_Policy_Set const&, TAO_Root_POA*, ACE_Lock&, 
ACE_Thread_Mutex&, TAO_ORB_Core&, TAO_Object_Adapter*) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)

Called from:
   0.8% : 0x4874637: 
TAO_Default_Servant_Dispatcher::create_Root_POA(ACE_String_Base<char> const&, 
TAO_POA_Manager&, TAO_POA_Policy_Set const&, ACE_Lock&, ACE_Thread_Mutex&, 
TAO_ORB_Core&, TAO_Object_Adapter*) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO_PortableServer.so.1.5.0)

---------------------------------
Context accounted for  0.7% of measured spacetime
  0x4698191: ACE_Local_Memory_Pool::acquire(unsigned, unsigned&) 
(Local_Memory_Pool.cpp:58)
  0x46980A9: ACE_Local_Memory_Pool::init_acquire(unsigned, unsigned&, int&) 
(Local_Memory_Pool.cpp:47)
  0x44BE159: ACE_Malloc_T<ACE_Local_Memory_Pool, ACE_Thread_Mutex, 
ACE_Control_Block>::open() (in /opt/COTS/ACE_wrappers/TAO/tao/libTAO.so.1.5.0)
  0x44BE313: ACE_Malloc_T<ACE_Local_Memory_Pool, ACE_Thread_Mutex, 
ACE_Control_Block>::ACE_Malloc_T(char const*) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO.so.1.5.0)

Called from:
   0.7% : 0x44BE39E: ACE_Allocator_Adapter<ACE_Malloc<ACE_Local_Memory_Pool, 
ACE_Thread_Mutex> >::ACE_Allocator_Adapter(char const*) (in 
/opt/COTS/ACE_wrappers/TAO/tao/libTAO.so.1.5.0)

=================================

End of information.  Rerun with a bigger --depth value for more.
_______________________________________________
Tsp-devel mailing list
[email protected]
http://lists.nongnu.org/mailman/listinfo/tsp-devel

Répondre à