Re: [PATCH] Fix PR60911

2014-04-28 Thread Richard Biener
On Fri, 25 Apr 2014, Jan Hubicka wrote:

  On Thu, 24 Apr 2014, Jan Hubicka wrote:
  

Simple IPA passes are supposed to see function bodies with IPA 
transforms 
applied - this is what the code in execute_one_pass tries to ensure.
But that doesn't work anymore with on-demand function-body loading.
The following addresses this in the least intrusive way - inlining
do_per_function (apply_ipa_transforms) and adjusting it accordingly.

This IMHO is definitely the solution for the 4.9 branch (and for
the time being on trunk).

Bootstrapped on x86_64-unknown-linux-gnu, testing in progress.

Ok for trunk and branch?
   
   I think it is fine for both 4.9 and mainline. I will try to make better 
   version
   for mainline as explained in PR hortly.
   
   Can you, please, double check that it won't load all bodies prior late 
   optimization by default? Looking at gate of pass_omp_simd_clone, perhaps 
  
  Well, first of all it will only load bodies with IPA transforms to apply
  (yeah, that includes inlining, right?).  Then it's only executed if
  a small IPA pass actually executes, but ...
 
 All functions have transforms to apply. They are added to all bodies of
 functions that are around when pass is run. Not only to those pass wants to do
 something. This is how first cut got implemented in 2004 and it is still the
 same. We may want to change this, since the per-function transform lists tends
 to be memory consuming these days. The reason why the lists are per-function
 was that I expected IPA passes to introduce new functions in the middle of
 optimization processing (it now happens for sample with ctor merging) and 
 those
 sould not be processed by transforms of IPA passes that never see them.
  
   it actually kills late loading of bodies and perhaps we need to mark in 
   cgraph node whether the given node needs clonning and page the gate 
   return false if partition has no such unit? bool 
   pass_omp_simd_clone::gate (function *) {
 return ((flag_openmp || flag_openmp_simd
  || flag_cilkplus
  || (in_lto_p  !flag_wpa))
  (targetm.simd_clone.compute_vecsize_and_simdlen != NULL));
   }
   
   I did not see there the in_lto_p previously.
  
  ... this is IIRC because you can't rely on -fopenmp/-fopenmp-simd/-fcilk+
  to be present on the LTO commandline.
 
 Yep, together with your change it will kill lazy loading, because the pass is
 practicaly unconditoinal with LTO and all functions will have transforms on 
 them.
 Adding simple flag if function needs openmp_simd processing would solve it.

Not really - you'd also have to defer body loading to the simple IPA
passes (well, and IPA PTA really needs all bodies anyway).  Here
OMP SIMD isn't really an IPA pass (other than it creating new
cgraph nodes).

Richard.

 Honza
  
  Richard.
  
   Honza

Thanks,
Richard.

2014-04-24  Richard Biener  rguent...@suse.de

PR ipa/60911
* passes.c (apply_ipa_transforms): Inline into only caller ...
(execute_one_pass): ... here.  Properly bring in function
bodies for nodes we want to apply IPA transforms to.

* gcc.dg/lto/pr60911_0.c: New testcase.

Index: gcc/passes.c
===
--- gcc/passes.c(revision 209742)
+++ gcc/passes.c(working copy)
@@ -2109,20 +2109,6 @@ execute_all_ipa_transforms (void)
 }
 }
 
-/* Callback for do_per_function to apply all IPA transforms.  */
-
-static void
-apply_ipa_transforms (void *data)
-{
-  struct cgraph_node *node = cgraph_get_node (current_function_decl);
-  if (!node-global.inlined_to  node-ipa_transforms_to_apply.exists 
())
-{
-  *(bool *)data = true;
-  execute_all_ipa_transforms ();
-  rebuild_cgraph_edges ();
-}
-}
-
 /* Check if PASS is explicitly disabled or enabled and return
the gate status.  FUNC is the function to be processed, and
GATE_STATUS is the gate status determined by pass manager by
@@ -2194,8 +2180,26 @@ execute_one_pass (opt_pass *pass)
  Apply all trnasforms first.  */
   if (pass-type == SIMPLE_IPA_PASS)
 {
+  struct cgraph_node *node;
   bool applied = false;
-  do_per_function (apply_ipa_transforms, (void *)applied);
+  FOR_EACH_DEFINED_FUNCTION (node)
+   if (node-analyzed
+cgraph_function_with_gimple_body_p (node)
+(!node-clone_of || node-decl != node-clone_of-decl))
+ {
+   if (!node-global.inlined_to
+node-ipa_transforms_to_apply.exists ())
+ {
+   cgraph_get_body (node);
+   push_cfun (DECL_STRUCT_FUNCTION (node-decl));
+   execute_all_ipa_transforms ();

Re: [PATCH] Fix PR60911

2014-04-25 Thread Richard Biener
On Thu, 24 Apr 2014, Jan Hubicka wrote:

  
  Simple IPA passes are supposed to see function bodies with IPA transforms 
  applied - this is what the code in execute_one_pass tries to ensure.
  But that doesn't work anymore with on-demand function-body loading.
  The following addresses this in the least intrusive way - inlining
  do_per_function (apply_ipa_transforms) and adjusting it accordingly.
  
  This IMHO is definitely the solution for the 4.9 branch (and for
  the time being on trunk).
  
  Bootstrapped on x86_64-unknown-linux-gnu, testing in progress.
  
  Ok for trunk and branch?
 
 I think it is fine for both 4.9 and mainline. I will try to make better 
 version
 for mainline as explained in PR hortly.
 
 Can you, please, double check that it won't load all bodies prior late 
 optimization by default? Looking at gate of pass_omp_simd_clone, perhaps 

Well, first of all it will only load bodies with IPA transforms to apply
(yeah, that includes inlining, right?).  Then it's only executed if
a small IPA pass actually executes, but ...

 it actually kills late loading of bodies and perhaps we need to mark in 
 cgraph node whether the given node needs clonning and page the gate 
 return false if partition has no such unit? bool 
 pass_omp_simd_clone::gate (function *) {
   return ((flag_openmp || flag_openmp_simd
|| flag_cilkplus
|| (in_lto_p  !flag_wpa))
(targetm.simd_clone.compute_vecsize_and_simdlen != NULL));
 }
 
 I did not see there the in_lto_p previously.

... this is IIRC because you can't rely on -fopenmp/-fopenmp-simd/-fcilk+
to be present on the LTO commandline.

Richard.

 Honza
  
  Thanks,
  Richard.
  
  2014-04-24  Richard Biener  rguent...@suse.de
  
  PR ipa/60911
  * passes.c (apply_ipa_transforms): Inline into only caller ...
  (execute_one_pass): ... here.  Properly bring in function
  bodies for nodes we want to apply IPA transforms to.
  
  * gcc.dg/lto/pr60911_0.c: New testcase.
  
  Index: gcc/passes.c
  ===
  --- gcc/passes.c(revision 209742)
  +++ gcc/passes.c(working copy)
  @@ -2109,20 +2109,6 @@ execute_all_ipa_transforms (void)
   }
   }
   
  -/* Callback for do_per_function to apply all IPA transforms.  */
  -
  -static void
  -apply_ipa_transforms (void *data)
  -{
  -  struct cgraph_node *node = cgraph_get_node (current_function_decl);
  -  if (!node-global.inlined_to  node-ipa_transforms_to_apply.exists ())
  -{
  -  *(bool *)data = true;
  -  execute_all_ipa_transforms ();
  -  rebuild_cgraph_edges ();
  -}
  -}
  -
   /* Check if PASS is explicitly disabled or enabled and return
  the gate status.  FUNC is the function to be processed, and
  GATE_STATUS is the gate status determined by pass manager by
  @@ -2194,8 +2180,26 @@ execute_one_pass (opt_pass *pass)
Apply all trnasforms first.  */
 if (pass-type == SIMPLE_IPA_PASS)
   {
  +  struct cgraph_node *node;
 bool applied = false;
  -  do_per_function (apply_ipa_transforms, (void *)applied);
  +  FOR_EACH_DEFINED_FUNCTION (node)
  +   if (node-analyzed
  +cgraph_function_with_gimple_body_p (node)
  +(!node-clone_of || node-decl != node-clone_of-decl))
  + {
  +   if (!node-global.inlined_to
  +node-ipa_transforms_to_apply.exists ())
  + {
  +   cgraph_get_body (node);
  +   push_cfun (DECL_STRUCT_FUNCTION (node-decl));
  +   execute_all_ipa_transforms ();
  +   rebuild_cgraph_edges ();
  +   free_dominance_info (CDI_DOMINATORS);
  +   free_dominance_info (CDI_POST_DOMINATORS);
  +   pop_cfun ();
  +   applied = true;
  + }
  + }
 if (applied)
   symtab_remove_unreachable_nodes (true, dump_file);
 /* Restore current_pass.  */
  Index: gcc/testsuite/gcc.dg/lto/pr60911_0.c
  ===
  --- gcc/testsuite/gcc.dg/lto/pr60911_0.c(revision 0)
  +++ gcc/testsuite/gcc.dg/lto/pr60911_0.c(working copy)
  @@ -0,0 +1,21 @@
  +// { dg-lto-do run }
  +// { dg-lto-options { { -O2 -flto -fipa-pta } } }
  +
  +int __attribute__ ((__noinline__)) f (unsigned *p, int *x)
  +{
  +  int y = *p++  0xfff;
  +  *x++ = y;
  +  *x = *p;
  +  return y;
  +}
  +
  +int
  +main ()
  +{
  +  unsigned u[2] = { 0x3aad, 0x5ad1 };
  +  int x[2] = { 17689, 23456 };
  +
  +  if (f (u, x) != 0xaad || x[0] != 0xaad || x[1] != 0x5ad1)
  +__builtin_abort ();
  +  return 0;
  +}
 
 

-- 
Richard Biener rguent...@suse.de
SUSE / SUSE Labs
SUSE LINUX Products GmbH - Nuernberg - AG Nuernberg - HRB 16746
GF: Jeff Hawn, Jennifer Guild, Felix Imendorffer


Re: [PATCH] Fix PR60911

2014-04-25 Thread Jan Hubicka
 On Thu, 24 Apr 2014, Jan Hubicka wrote:
 
   
   Simple IPA passes are supposed to see function bodies with IPA transforms 
   applied - this is what the code in execute_one_pass tries to ensure.
   But that doesn't work anymore with on-demand function-body loading.
   The following addresses this in the least intrusive way - inlining
   do_per_function (apply_ipa_transforms) and adjusting it accordingly.
   
   This IMHO is definitely the solution for the 4.9 branch (and for
   the time being on trunk).
   
   Bootstrapped on x86_64-unknown-linux-gnu, testing in progress.
   
   Ok for trunk and branch?
  
  I think it is fine for both 4.9 and mainline. I will try to make better 
  version
  for mainline as explained in PR hortly.
  
  Can you, please, double check that it won't load all bodies prior late 
  optimization by default? Looking at gate of pass_omp_simd_clone, perhaps 
 
 Well, first of all it will only load bodies with IPA transforms to apply
 (yeah, that includes inlining, right?).  Then it's only executed if
 a small IPA pass actually executes, but ...

All functions have transforms to apply. They are added to all bodies of
functions that are around when pass is run. Not only to those pass wants to do
something. This is how first cut got implemented in 2004 and it is still the
same. We may want to change this, since the per-function transform lists tends
to be memory consuming these days. The reason why the lists are per-function
was that I expected IPA passes to introduce new functions in the middle of
optimization processing (it now happens for sample with ctor merging) and those
sould not be processed by transforms of IPA passes that never see them.
 
  it actually kills late loading of bodies and perhaps we need to mark in 
  cgraph node whether the given node needs clonning and page the gate 
  return false if partition has no such unit? bool 
  pass_omp_simd_clone::gate (function *) {
return ((flag_openmp || flag_openmp_simd
 || flag_cilkplus
 || (in_lto_p  !flag_wpa))
 (targetm.simd_clone.compute_vecsize_and_simdlen != NULL));
  }
  
  I did not see there the in_lto_p previously.
 
 ... this is IIRC because you can't rely on -fopenmp/-fopenmp-simd/-fcilk+
 to be present on the LTO commandline.

Yep, together with your change it will kill lazy loading, because the pass is
practicaly unconditoinal with LTO and all functions will have transforms on 
them.
Adding simple flag if function needs openmp_simd processing would solve it.

Honza
 
 Richard.
 
  Honza
   
   Thanks,
   Richard.
   
   2014-04-24  Richard Biener  rguent...@suse.de
   
 PR ipa/60911
 * passes.c (apply_ipa_transforms): Inline into only caller ...
 (execute_one_pass): ... here.  Properly bring in function
 bodies for nodes we want to apply IPA transforms to.
   
 * gcc.dg/lto/pr60911_0.c: New testcase.
   
   Index: gcc/passes.c
   ===
   --- gcc/passes.c  (revision 209742)
   +++ gcc/passes.c  (working copy)
   @@ -2109,20 +2109,6 @@ execute_all_ipa_transforms (void)
}
}

   -/* Callback for do_per_function to apply all IPA transforms.  */
   -
   -static void
   -apply_ipa_transforms (void *data)
   -{
   -  struct cgraph_node *node = cgraph_get_node (current_function_decl);
   -  if (!node-global.inlined_to  node-ipa_transforms_to_apply.exists 
   ())
   -{
   -  *(bool *)data = true;
   -  execute_all_ipa_transforms ();
   -  rebuild_cgraph_edges ();
   -}
   -}
   -
/* Check if PASS is explicitly disabled or enabled and return
   the gate status.  FUNC is the function to be processed, and
   GATE_STATUS is the gate status determined by pass manager by
   @@ -2194,8 +2180,26 @@ execute_one_pass (opt_pass *pass)
 Apply all trnasforms first.  */
  if (pass-type == SIMPLE_IPA_PASS)
{
   +  struct cgraph_node *node;
  bool applied = false;
   -  do_per_function (apply_ipa_transforms, (void *)applied);
   +  FOR_EACH_DEFINED_FUNCTION (node)
   + if (node-analyzed
   +  cgraph_function_with_gimple_body_p (node)
   +  (!node-clone_of || node-decl != node-clone_of-decl))
   +   {
   + if (!node-global.inlined_to
   +  node-ipa_transforms_to_apply.exists ())
   +   {
   + cgraph_get_body (node);
   + push_cfun (DECL_STRUCT_FUNCTION (node-decl));
   + execute_all_ipa_transforms ();
   + rebuild_cgraph_edges ();
   + free_dominance_info (CDI_DOMINATORS);
   + free_dominance_info (CDI_POST_DOMINATORS);
   + pop_cfun ();
   + applied = true;
   +   }
   +   }
  if (applied)
symtab_remove_unreachable_nodes (true, dump_file);
  /* Restore current_pass.  */
   Index: gcc/testsuite/gcc.dg/lto/pr60911_0.c
   ===
   --- 

[PATCH] Fix PR60911

2014-04-24 Thread Richard Biener

Simple IPA passes are supposed to see function bodies with IPA transforms 
applied - this is what the code in execute_one_pass tries to ensure.
But that doesn't work anymore with on-demand function-body loading.
The following addresses this in the least intrusive way - inlining
do_per_function (apply_ipa_transforms) and adjusting it accordingly.

This IMHO is definitely the solution for the 4.9 branch (and for
the time being on trunk).

Bootstrapped on x86_64-unknown-linux-gnu, testing in progress.

Ok for trunk and branch?

Thanks,
Richard.

2014-04-24  Richard Biener  rguent...@suse.de

PR ipa/60911
* passes.c (apply_ipa_transforms): Inline into only caller ...
(execute_one_pass): ... here.  Properly bring in function
bodies for nodes we want to apply IPA transforms to.

* gcc.dg/lto/pr60911_0.c: New testcase.

Index: gcc/passes.c
===
--- gcc/passes.c(revision 209742)
+++ gcc/passes.c(working copy)
@@ -2109,20 +2109,6 @@ execute_all_ipa_transforms (void)
 }
 }
 
-/* Callback for do_per_function to apply all IPA transforms.  */
-
-static void
-apply_ipa_transforms (void *data)
-{
-  struct cgraph_node *node = cgraph_get_node (current_function_decl);
-  if (!node-global.inlined_to  node-ipa_transforms_to_apply.exists ())
-{
-  *(bool *)data = true;
-  execute_all_ipa_transforms ();
-  rebuild_cgraph_edges ();
-}
-}
-
 /* Check if PASS is explicitly disabled or enabled and return
the gate status.  FUNC is the function to be processed, and
GATE_STATUS is the gate status determined by pass manager by
@@ -2194,8 +2180,26 @@ execute_one_pass (opt_pass *pass)
  Apply all trnasforms first.  */
   if (pass-type == SIMPLE_IPA_PASS)
 {
+  struct cgraph_node *node;
   bool applied = false;
-  do_per_function (apply_ipa_transforms, (void *)applied);
+  FOR_EACH_DEFINED_FUNCTION (node)
+   if (node-analyzed
+cgraph_function_with_gimple_body_p (node)
+(!node-clone_of || node-decl != node-clone_of-decl))
+ {
+   if (!node-global.inlined_to
+node-ipa_transforms_to_apply.exists ())
+ {
+   cgraph_get_body (node);
+   push_cfun (DECL_STRUCT_FUNCTION (node-decl));
+   execute_all_ipa_transforms ();
+   rebuild_cgraph_edges ();
+   free_dominance_info (CDI_DOMINATORS);
+   free_dominance_info (CDI_POST_DOMINATORS);
+   pop_cfun ();
+   applied = true;
+ }
+ }
   if (applied)
 symtab_remove_unreachable_nodes (true, dump_file);
   /* Restore current_pass.  */
Index: gcc/testsuite/gcc.dg/lto/pr60911_0.c
===
--- gcc/testsuite/gcc.dg/lto/pr60911_0.c(revision 0)
+++ gcc/testsuite/gcc.dg/lto/pr60911_0.c(working copy)
@@ -0,0 +1,21 @@
+// { dg-lto-do run }
+// { dg-lto-options { { -O2 -flto -fipa-pta } } }
+
+int __attribute__ ((__noinline__)) f (unsigned *p, int *x)
+{
+  int y = *p++  0xfff;
+  *x++ = y;
+  *x = *p;
+  return y;
+}
+
+int
+main ()
+{
+  unsigned u[2] = { 0x3aad, 0x5ad1 };
+  int x[2] = { 17689, 23456 };
+
+  if (f (u, x) != 0xaad || x[0] != 0xaad || x[1] != 0x5ad1)
+__builtin_abort ();
+  return 0;
+}


Re: [PATCH] Fix PR60911

2014-04-24 Thread Jan Hubicka
 
 Simple IPA passes are supposed to see function bodies with IPA transforms 
 applied - this is what the code in execute_one_pass tries to ensure.
 But that doesn't work anymore with on-demand function-body loading.
 The following addresses this in the least intrusive way - inlining
 do_per_function (apply_ipa_transforms) and adjusting it accordingly.
 
 This IMHO is definitely the solution for the 4.9 branch (and for
 the time being on trunk).
 
 Bootstrapped on x86_64-unknown-linux-gnu, testing in progress.
 
 Ok for trunk and branch?

I think it is fine for both 4.9 and mainline. I will try to make better version
for mainline as explained in PR hortly.

Can you, please, double check that it won't load all bodies prior late 
optimization
by default? 
Looking at gate of pass_omp_simd_clone, perhaps it actually kills late loading
of bodies and perhaps we need to mark in cgraph node whether the given node
needs clonning and page the gate return false if partition has no such unit?
bool
pass_omp_simd_clone::gate (function *)
{
  return ((flag_openmp || flag_openmp_simd
   || flag_cilkplus
   || (in_lto_p  !flag_wpa))
   (targetm.simd_clone.compute_vecsize_and_simdlen != NULL));
}

I did not see there the in_lto_p previously.

Honza
 
 Thanks,
 Richard.
 
 2014-04-24  Richard Biener  rguent...@suse.de
 
   PR ipa/60911
   * passes.c (apply_ipa_transforms): Inline into only caller ...
   (execute_one_pass): ... here.  Properly bring in function
   bodies for nodes we want to apply IPA transforms to.
 
   * gcc.dg/lto/pr60911_0.c: New testcase.
 
 Index: gcc/passes.c
 ===
 --- gcc/passes.c  (revision 209742)
 +++ gcc/passes.c  (working copy)
 @@ -2109,20 +2109,6 @@ execute_all_ipa_transforms (void)
  }
  }
  
 -/* Callback for do_per_function to apply all IPA transforms.  */
 -
 -static void
 -apply_ipa_transforms (void *data)
 -{
 -  struct cgraph_node *node = cgraph_get_node (current_function_decl);
 -  if (!node-global.inlined_to  node-ipa_transforms_to_apply.exists ())
 -{
 -  *(bool *)data = true;
 -  execute_all_ipa_transforms ();
 -  rebuild_cgraph_edges ();
 -}
 -}
 -
  /* Check if PASS is explicitly disabled or enabled and return
 the gate status.  FUNC is the function to be processed, and
 GATE_STATUS is the gate status determined by pass manager by
 @@ -2194,8 +2180,26 @@ execute_one_pass (opt_pass *pass)
   Apply all trnasforms first.  */
if (pass-type == SIMPLE_IPA_PASS)
  {
 +  struct cgraph_node *node;
bool applied = false;
 -  do_per_function (apply_ipa_transforms, (void *)applied);
 +  FOR_EACH_DEFINED_FUNCTION (node)
 + if (node-analyzed
 +  cgraph_function_with_gimple_body_p (node)
 +  (!node-clone_of || node-decl != node-clone_of-decl))
 +   {
 + if (!node-global.inlined_to
 +  node-ipa_transforms_to_apply.exists ())
 +   {
 + cgraph_get_body (node);
 + push_cfun (DECL_STRUCT_FUNCTION (node-decl));
 + execute_all_ipa_transforms ();
 + rebuild_cgraph_edges ();
 + free_dominance_info (CDI_DOMINATORS);
 + free_dominance_info (CDI_POST_DOMINATORS);
 + pop_cfun ();
 + applied = true;
 +   }
 +   }
if (applied)
  symtab_remove_unreachable_nodes (true, dump_file);
/* Restore current_pass.  */
 Index: gcc/testsuite/gcc.dg/lto/pr60911_0.c
 ===
 --- gcc/testsuite/gcc.dg/lto/pr60911_0.c  (revision 0)
 +++ gcc/testsuite/gcc.dg/lto/pr60911_0.c  (working copy)
 @@ -0,0 +1,21 @@
 +// { dg-lto-do run }
 +// { dg-lto-options { { -O2 -flto -fipa-pta } } }
 +
 +int __attribute__ ((__noinline__)) f (unsigned *p, int *x)
 +{
 +  int y = *p++  0xfff;
 +  *x++ = y;
 +  *x = *p;
 +  return y;
 +}
 +
 +int
 +main ()
 +{
 +  unsigned u[2] = { 0x3aad, 0x5ad1 };
 +  int x[2] = { 17689, 23456 };
 +
 +  if (f (u, x) != 0xaad || x[0] != 0xaad || x[1] != 0x5ad1)
 +__builtin_abort ();
 +  return 0;
 +}