> OSError: [Errno 24] Too many open files: '/tmp/pytest-of-unshare/pytest-0'
>
> My question, his how van I debug this sort os issue ?

> Perhaps the maximum number of files concurrently open differs on your local
> machine vs. the one used as remote for the CI.  By `ulimit -a` the thresholds
> are print to the CLI.  By `ulimit --help | less` it looks like `ulimit -n`
> provides an adjustment of the limit in question.

the default seems to be 1024 on my unstable system.

the test fail with Python3.14 but not with Python3.13.

so this is a difference 

I did this on my local machine and it works if I set this limits says to 10000.
picca@page:~$ ulimit -n
1024

picca@page:~$ python3.14 -m pytest --pyargs tomoscan
=================================================================================================================================
 test session starts 
==================================================================================================================================
platform linux -- Python 3.14.3, pytest-9.0.2, pluggy-1.6.0
rootdir: /home/picca
plugins: cov-5.0.0, zarr-3.1.5, typeguard-4.4.4, anyio-4.11.0, asyncio-1.3.0
asyncio: mode=Mode.STRICT, debug=False, 
asyncio_default_fixture_loop_scope=None, 
asyncio_default_test_loop_scope=function
collected 298 items                                                             
                                                                                
                                                                                
                                       

esrf/identifier/tests/test_edfidentifier.py .                                   
                                                                                
                                                                                
                                 [  0%]
esrf/identifier/tests/test_hdf5identifier.py .                                  
                                                                                
                                                                                
                                 [  0%]
esrf/identifier/tests/test_rawidentifier.py .                                   
                                                                                
                                                                                
                                 [  1%]
esrf/scan/framereducer/tests/test_edfframereducer.py ..                         
                                                                                
                                                                                
                                 [  1%]
esrf/scan/framereducer/tests/test_hdf5framereducer.py ....                      
                                                                                
                                                                                
                                 [  3%]
esrf/scan/tests/test_edfscan.py ...........................................     
                                                                                
                                                                                
                                 [ 17%]
esrf/scan/tests/test_fscan.py .                                                 
                                                                                
                                                                                
                                 [ 17%]
esrf/scan/tests/test_mock.py .......                                            
                                                                                
                                                                                
                                 [ 20%]
esrf/scan/tests/test_nxtomoscan.py .......................................      
                                                                                
                                                                                
                                 [ 33%]
esrf/scan/tests/test_nxtomoscan_mcstas.py ...                                   
                                                                                
                                                                                
                                 [ 34%]
esrf/scan/tests/test_utils.py ........                                          
                                                                                
                                                                                
                                 [ 36%]
esrf/volume/tests/test_edfvolume.py .                                           
                                                                                
                                                                                
                                 [ 37%]
esrf/volume/tests/test_hdf5volume.py .........                                  
                                                                                
                                                                                
                                 [ 40%]
esrf/volume/tests/test_jp2kvolume.py ..                                         
                                                                                
                                                                                
                                 [ 40%]
esrf/volume/tests/test_raw_volume.py .....                                      
                                                                                
                                                                                
                                 [ 42%]
esrf/volume/tests/test_single_frame_volume.py 
......................................                                          
                                                                                
                                                                   [ 55%]
esrf/volume/tests/test_tiffvolume.py .....                                      
                                                                                
                                                                                
                                 [ 57%]
esrf/volume/tests/test_volume_esrf_utils.py ......                              
                                                                                
                                                                                
                                 [ 59%]
framereducer/tests/test_ReduceFrameSaver.py .                                   
                                                                                
                                                                                
                                 [ 59%]
framereducer/tests/test_framereducerbase.py .                                   
                                                                                
                                                                                
                                 [ 59%]
normalization/tests/test_normalization.py ......................                
                                                                                
                                                                                
                                 [ 67%]
tests/test_drac_utils.py .                                                      
                                                                                
                                                                                
                                 [ 67%]
tests/test_factory.py ......                                                    
                                                                                
                                                                                
                                 [ 69%]
tests/test_hdf5_utils.py .                                                      
                                                                                
                                                                                
                                 [ 69%]
tests/test_io.py ..                                                             
                                                                                
                                                                                
                                 [ 70%]
tests/test_progress.py ..                                                       
                                                                                
                                                                                
                                 [ 71%]
tests/test_scanbase.py .....                                                    
                                                                                
                                                                                
                                 [ 72%]
tests/test_serie.py .....                                                       
                                                                                
                                                                                
                                 [ 74%]
tests/test_tomoobject.py .                                                      
                                                                                
                                                                                
                                 [ 74%]
tests/test_utils.py ...                                                         
                                                                                
                                                                                
                                 [ 75%]
tests/test_validator.py 
........................................................                        
                                                                                
                                                                                
         [ 94%]
tests/test_version.py .                                                         
                                                                                
                                                                                
                                 [ 94%]
tests/test_volume_base.py .                                                     
                                                                                
                                                                                
                                 [ 95%]
tests/test_volume_utils.py ...........FE.E                                      
                                                                                
                                                                                
                                 [100%]


picca@page:~$ python3.13 -m pytest --pyargs tomoscan
=================================================================================================================================
 test session starts 
==================================================================================================================================
platform linux -- Python 3.13.12, pytest-9.0.2, pluggy-1.6.0
rootdir: /home/picca
plugins: cov-5.0.0, zarr-3.1.5, typeguard-4.4.4, anyio-4.11.0, asyncio-1.3.0
asyncio: mode=Mode.STRICT, debug=False, 
asyncio_default_fixture_loop_scope=None, 
asyncio_default_test_loop_scope=function
collected 298 items                                                             
                                                                                
                                                                                
                                       

esrf/identifier/tests/test_edfidentifier.py .                                   
                                                                                
                                                                                
                                 [  0%]
esrf/identifier/tests/test_hdf5identifier.py .                                  
                                                                                
                                                                                
                                 [  0%]
esrf/identifier/tests/test_rawidentifier.py .                                   
                                                                                
                                                                                
                                 [  1%]
esrf/scan/framereducer/tests/test_edfframereducer.py ..                         
                                                                                
                                                                                
                                 [  1%]
esrf/scan/framereducer/tests/test_hdf5framereducer.py ....                      
                                                                                
                                                                                
                                 [  3%]
esrf/scan/tests/test_edfscan.py ...........................................     
                                                                                
                                                                                
                                 [ 17%]
esrf/scan/tests/test_fscan.py .                                                 
                                                                                
                                                                                
                                 [ 17%]
esrf/scan/tests/test_mock.py .......                                            
                                                                                
                                                                                
                                 [ 20%]
esrf/scan/tests/test_nxtomoscan.py .......................................      
                                                                                
                                                                                
                                 [ 33%]
esrf/scan/tests/test_nxtomoscan_mcstas.py ...                                   
                                                                                
                                                                                
                                 [ 34%]
esrf/scan/tests/test_utils.py ........                                          
                                                                                
                                                                                
                                 [ 36%]
esrf/volume/tests/test_edfvolume.py .                                           
                                                                                
                                                                                
                                 [ 37%]
esrf/volume/tests/test_hdf5volume.py .........                                  
                                                                                
                                                                                
                                 [ 40%]
esrf/volume/tests/test_jp2kvolume.py ..                                         
                                                                                
                                                                                
                                 [ 40%]
esrf/volume/tests/test_raw_volume.py .....                                      
                                                                                
                                                                                
                                 [ 42%]
esrf/volume/tests/test_single_frame_volume.py 
......................................                                          
                                                                                
                                                                   [ 55%]
esrf/volume/tests/test_tiffvolume.py .....                                      
                                                                                
                                                                                
                                 [ 57%]
esrf/volume/tests/test_volume_esrf_utils.py ......                              
                                                                                
                                                                                
                                 [ 59%]
framereducer/tests/test_ReduceFrameSaver.py .                                   
                                                                                
                                                                                
                                 [ 59%]
framereducer/tests/test_framereducerbase.py .                                   
                                                                                
                                                                                
                                 [ 59%]
normalization/tests/test_normalization.py ......................                
                                                                                
                                                                                
                                 [ 67%]
tests/test_drac_utils.py .                                                      
                                                                                
                                                                                
                                 [ 67%]
tests/test_factory.py ......                                                    
                                                                                
                                                                                
                                 [ 69%]
tests/test_hdf5_utils.py .                                                      
                                                                                
                                                                                
                                 [ 69%]
tests/test_io.py ..                                                             
                                                                                
                                                                                
                                 [ 70%]
tests/test_progress.py ..                                                       
                                                                                
                                                                                
                                 [ 71%]
tests/test_scanbase.py .....                                                    
                                                                                
                                                                                
                                 [ 72%]
tests/test_serie.py .....                                                       
                                                                                
                                                                                
                                 [ 74%]
tests/test_tomoobject.py .                                                      
                                                                                
                                                                                
                                 [ 74%]
tests/test_utils.py ...                                                         
                                                                                
                                                                                
                                 [ 75%]
tests/test_validator.py 
........................................................                        
                                                                                
                                                                                
         [ 94%]
tests/test_version.py .                                                         
                                                                                
                                                                                
                                 [ 94%]
tests/test_volume_base.py .                                                     
                                                                                
                                                                                
                                 [ 95%]
tests/test_volume_utils.py ..............                                       
                                                                                
                                                                                
                                 [100%]

============================================================================================================================
 298 passed in 68.73s (0:01:08) 
============================================================================================================================

If I set this limits to 10000 it works for Python3.14 and Python3.13

I can not run the test in autopkgtest due to this bug

https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1123612




Regards,
Norwid


Reply via email to