[
https://issues.apache.org/jira/browse/ARROW-4716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Francois Saint-Jacques updated ARROW-4716:
------------------------------------------
Description:
The machine detection script ({{make_machine_json.sh}}) currently looks like it
will only work properly on macOS. Ideally it should work more or less correctly
on all of them macOS, Linux and Windows (some values may remain undetected on
some platforms).
This probably entails:
- extend `archery benchmark` (see
https://jira.apache.org/jira/browse/ARROW-4827 and tentative implementation in
[https://github.com/apache/arrow/pull/4077/files]) rather than a standalone
bash script
- using something like [psutil|https://psutil.readthedocs.io/en/latest/] to
grab useful machine information
- calling {{nvidia-smi}} to query GPU characteristics (for example "nvidia-smi
-q -i 0 -x")
was:
The machine detection script ({{make_machine_json.sh}}) currently looks like it
will only work properly on macOS. Ideally it should work more or less correctly
on all of them macOS, Linux and Windows (some values may remain undetected on
some platforms).
This probably entails:
- switching to Python rather than bash
- using something like [psutil|https://psutil.readthedocs.io/en/latest/] to
grab useful machine information
- calling {{nvidia-smi}} to query GPU characteristics (for example "nvidia-smi
-q -i 0 -x")
> [Benchmarking] Add portable machine and benchmark context detection
> -------------------------------------------------------------------
>
> Key: ARROW-4716
> URL: https://issues.apache.org/jira/browse/ARROW-4716
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Benchmarking
> Reporter: Antoine Pitrou
> Priority: Major
>
> The machine detection script ({{make_machine_json.sh}}) currently looks like
> it will only work properly on macOS. Ideally it should work more or less
> correctly on all of them macOS, Linux and Windows (some values may remain
> undetected on some platforms).
> This probably entails:
> - extend `archery benchmark` (see
> https://jira.apache.org/jira/browse/ARROW-4827 and tentative implementation
> in [https://github.com/apache/arrow/pull/4077/files]) rather than a
> standalone bash script
> - using something like [psutil|https://psutil.readthedocs.io/en/latest/] to
> grab useful machine information
> - calling {{nvidia-smi}} to query GPU characteristics (for example
> "nvidia-smi -q -i 0 -x")
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
