[
https://issues.apache.org/jira/browse/ARROW-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16748116#comment-16748116
]
Antoine Pitrou commented on ARROW-4312:
---------------------------------------
Using a Pool would probably have been better. Also the current solution will
waste tons of memory (say that each child process takes 50 MB, then your 600
processes can potentially require 30 GB RAM).
> [C++] Lint doesn't work anymore ("[Errno 24] Too many open files")
> ------------------------------------------------------------------
>
> Key: ARROW-4312
> URL: https://issues.apache.org/jira/browse/ARROW-4312
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Developer Tools
> Reporter: Antoine Pitrou
> Assignee: Benjamin Kietzman
> Priority: Major
>
> {code}
> -- Building using CMake version: 3.12.2
> -- Arrow version: 0.13.0 (full: '0.13.0-SNAPSHOT')
> -- clang-tidy not found
> -- clang-format found at /usr/bin/clang-format-6.0
> -- infer found at /home/antoine/infer-linux64-v0.15.0/bin/infer
> -- Using ccache: /usr/bin/ccache
> -- Found cpplint executable at
> /home/antoine/arrow/cpp/build-support/cpplint.py
> -- Configuring done
> -- Generating done
> -- Build files have been written to: /home/antoine/arrow/cpp/build-lint
> Built target lint
> Traceback (most recent call last):
> File "/home/antoine/arrow/cpp/build-support/run_clang_format.py", line 105,
> in <module>
> ], stdout=PIPE, stderr=PIPE)
> File "/home/antoine/arrow/cpp/build-support/lintutils.py", line 59, in
> run_parallel
> procs.append(Popen(cmd, **kwargs))
> File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/subprocess.py",
> line 775, in __init__
> restore_signals, start_new_session)
> File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/subprocess.py",
> line 1412, in _execute_child
> errpipe_read, errpipe_write = os.pipe()
> OSError: [Errno 24] Too many open files
> CMakeFiles/check-format.dir/build.make:57: recipe for target
> 'CMakeFiles/check-format' failed
> make[3]: *** [CMakeFiles/check-format] Error 1
> CMakeFiles/Makefile2:72: recipe for target 'CMakeFiles/check-format.dir/all'
> failed
> make[2]: *** [CMakeFiles/check-format.dir/all] Error 2
> CMakeFiles/Makefile2:79: recipe for target 'CMakeFiles/check-format.dir/rule'
> failed
> make[1]: *** [CMakeFiles/check-format.dir/rule] Error 2
> Makefile:118: recipe for target 'check-format' failed
> make: *** [check-format] Error 2
> ~/arrow/cpp
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
