Has anyone worked on or expressed interest in python bindings for the hwloc
library? I do most of my work in python and would find it useful.
I threw together a python implementation of the hwloc-hello program in
python, using ctypes to access the library. It was fairly straight-forward.
I
On 11/30/2010 10:52 AM, Jeff Squyres wrote:
On Nov 30, 2010, at 11:44 AM, Guy Streeter wrote:
Would anyone object if I take a whack at making some SWIG bindings for hwloc?
I'm thinking specifically for perl (because that's my scripting language of
choice), but I could probably be convinced
On 12/15/2010 02:02 PM, Brice Goglin wrote:
...
As I said, we're trying to keep things consistent. My understanding is
that a function should have a topology parameter if it traverses some
links between objects inside the topology. If it only operates on a
given object and does not traverse the
On 12/20/2010 12:56 PM, Brice Goglin wrote:
Le 20/12/2010 19:40, Guy Streeter a écrit :
Get this singlethreaded process memory : expected 0x000f, got
0xf...f
Is that a bug?
That's on my Fedora 13 non-numa system.
This is kind of expected. 0x000f means all the cores in the machine
On 12/22/2010 02:36 AM, Brice Goglin wrote:
I'll backport this in 1.1 later, in case somebody wants to fix the
English speaking.
Brice
For the benefit of the Perl and Python bindings efforts, it would be good if
we could query the runtime library for it's API version.
--Guy
Le
On 12/22/2010 09:02 AM, Brice Goglin wrote:
Le 22/12/2010 15:59, Guy Streeter a écrit :
On 12/22/2010 02:36 AM, Brice Goglin wrote:
I'll backport this in 1.1 later, in case somebody wants to fix the
English speaking.
Brice
For the benefit of the Perl and Python bindings efforts, it would
I'm using 1.1 on Fedora 13. I start with
set = hwloc_bitmap_alloc_full()
and it looks like
0xf...f
Then I call
hwloc_bitmap_from_ith_ulong(set, 1, 0xdeadbeef)
and I get
0xdeadbeef,0x0034,0x3f77aed8
which I don't understand.
Example code is attached.
thanks,
--Guy
#include
#include
On 12/22/2010 01:50 PM, Guy Streeter wrote:
I'm using 1.1 on Fedora 13. I start with
set = hwloc_bitmap_alloc_full()
and it looks like
0xf...f
Then I call
hwloc_bitmap_from_ith_ulong(set, 1, 0xdeadbeef)
and I get
0xdeadbeef,0x0034,0x3f77aed8
which I don't understand.
Example code
I am currently working to get a public git repository set up so that I can
share the work. In the meantime, my first pass at python bindings for hwloc
are available from
http://people.redhat.com/streeter/
There are rpm files and a source tarball there. The tarball has
implementations of some
On 01/20/2011 11:32 AM, Samuel Thibault wrote:
Hello,
Guy Streeter, le Mon 17 Jan 2011 21:03:04 +0100, a écrit :
I am currently working to get a public git repository set up so that I can
share the work. In the meantime, my first pass at python bindings for hwloc
are available from
http
On 01/20/2011 01:22 PM, Samuel Thibault wrote:
Bernd Kallies, le Thu 20 Jan 2011 20:13:03 +0100, a écrit :
The only thing I was wondering about are these OO method names, which I
had to invent them myself. If there is some need to synchronize these
with the python binding, we may agree about
The python bindings are now available at
http://git.fedorahosted.org/git/python-hwloc.git
or
git://git.fedorahosted.org/python-hwloc.git
--Guy
On 01/21/2011 10:48 AM, Guy Streeter wrote:
The python bindings are now available at
http://git.fedorahosted.org/git/python-hwloc.git
or
git://git.fedorahosted.org/python-hwloc.git
--Guy
I have significantly updated the python bindings implementation:
Renamed the classes; Topology, Obj
else if (!strncmp(argv[1], "interleace", 2))
should be
else if (!strncmp(argv[1], "interleave", 2))
--Guy
The output of hwloc_obj_attr_snprintf() is arbitrarily limited. In particular,
the infos portion is at most 255 characters long. On my systems there is quite
a bit more in the infos for the machine object.
--Guy
I was considering the design of an administration tool in python, and my
original idea was to have each module that needs the topology object create
its own. This means that different parts of the same program (but possibly in
different threads) would call init and load on their own topology
The man page and the online documentation for hwloc_topology_set_synthetic()
both say that it takes a comma-separated list as input. It appears to take a
space-separated list instead.
Also, the documentation does not indicate what the return value means. When
the input description cannot be
I have updated the python bindings to support hwloc-1.2. They are
backward-compatible with 1.1.
There is a Fedora rpm and a tarball on http://people.redhat.com/streeter/
and the git archive is
git://git.fedorahosted.org/python-hwloc.git
ssh://git.fedorahosted.org/git/python-hwloc.git
pciutils was re-based to 3.1.7 in RHEL5.6 at the request of some of our
hardware partners, in order to add some new hardware support.
That'd explain why I didn't hit it when I was testing
previously, we were still on CentOS 5.4 and RHEL 5.5
then so obviously this dependency is new in RHEL
On 10/11/2011 01:59 AM, Brice Goglin wrote:
Anybody against releasing the final v1.3?
We only had the following changes since v1.3rc2. Nothing worth a new
tarball?
* Fix lstopo crash in verbose messages about offline/disallowed/...
processors when root has no cpuset, just don't display anything
I have a RHEL6.1 system on which I get a glibc error report:
*** glibc detected *** hwloc-1.3/bin/lstopo: double free or corruption
(!prev): 0x01945630 ***
=== Backtrace: =
/lib64/libc.so.6[0x3d1a275716]
/lib64/libpci.so.3[0x3d1aa06bdf]
On 11/03/2011 12:51 PM, Guy Streeter wrote:
> I have a RHEL6.1 system on which I get a glibc error report:
>
> *** glibc detected *** hwloc-1.3/bin/lstopo: double free or corruption
> (!prev): 0x01945630 ***
> === Backtrace: =
> /lib64/libc.so.6[0x3d
This question may be more about understanding NUMA (which I barely do) than
about hwloc, but perhaps you can help anyway.
I have a customer with some HP Proliant DL580 G7 servers. HP supplied them
with a block diagram of their system, and it shows two of the NUMA nodes
connected to the PCI
On 11/28/2011 03:45 PM, Brice Goglin wrote:
...
> Current Intel platforms have 2 QPI links going to I/O hubs. Most servers
> with many sockets (4 or more) thus have each I/O hub connected to only 2
> processors directly, so their distance is "equal" as you say.
>
> However, some BIOS report
On 04/25/2012 04:38 AM, Brice Goglin wrote:
> Hello,
>
> We recently got some complains from redhat/centos users that wanted to install
> hwloc on their cluster but couldn't because it brought so many X libraries
> that they don't care about.
>
> Debian solves this by having two hwloc packages:
I have updated python-hwloc to support version 1.5 of hwloc. It is available at
git://git.fedorahosted.org/python-hwloc.git
as well as rpm packages and source tarball on
http://people.redhat.com/streeter/
In the course of this, I added the linux_libnuma calls. python-hwloc now
depends on
I'm trying to understand why for one of my systems the disk controller is not
shown as an OS device. The PCI device is seen, but there is no OS device under
it. It's a SATA controller emulated as SCSI, It think.
gather-topology output is attached. Using hwloc 1.5 on Fedora 17.
thanks,
--Guy
On 10/09/2012 02:03 PM, Brice Goglin wrote:
> Le 09/10/2012 20:47, Guy Streeter a écrit :
>> I'm trying to understand why for one of my systems the disk controller is not
>> shown as an OS device. The PCI device is seen, but there is no OS device
>> under
>> it. It's
On 10/09/2012 02:18 PM, Guy Streeter wrote:
> On 10/09/2012 02:03 PM, Brice Goglin wrote:
>> Le 09/10/2012 20:47, Guy Streeter a écrit :
>>> I'm trying to understand why for one of my systems the disk controller is
>>> not
>>> shown as an OS device. The PC
On 10/09/2012 03:12 PM, Brice Goglin wrote:
> Le 09/10/2012 22:12, Brice Goglin a écrit :
>> The attached patch should help (and fix minor bugs nearby).
>>
>> Brice
>>
>
> Patch attached for real.
>
>
Yep, works fine.
Thanks for the fast response!
--Guy
When I'm trying to visualize how my system is physically configured, in order
to decide how best to bind applications, I'd like to know about every source
of interrupts. keyboard and mouse, timers, sound, USB-connected devices, etc.
Has any though been given to expanding the OS device information
I noticed on my system (Fedora 17) that the OS Devices don't have their own
cpuset. It seems like it would be good to know the affinity of the interrupt
assigned to the device. Is there a provision for this in hwloc, or would I
need to find it another way?
thanks,
--Guy
On 11/06/2012 03:53 PM, Brice Goglin wrote:
> Hello Guy,
>
> I don't think OS devices ever had a cpuset. All objects that are not
> things where you can bind processes usually have NULL cpusets. So when
> you have a PCI or OS device, you walk up the obj->parent pointer until
> you find an object
On 11/06/2012 05:20 PM, Brice Goglin wrote:
> Le 06/11/2012 23:55, Guy Streeter a écrit :
>> On 11/06/2012 03:53 PM, Brice Goglin wrote:
>>> Hello Guy,
>>>
>>> I don't think OS devices ever had a cpuset. All objects that are not
>>> things where you can
I have finally made the 1.6 additions to python-hwloc. userdata and xml
import/export od userdata works.
I spent some time trying to find a way to let userdata be a reference to a
python object, but in the end decided to leave associating the userdata value
with data in python space up to the
"hwloc-assembler-remote --help"
shows a --force option not mentioned in the man-page.
The man page documents a --verbose option not recognized by the command.
"hwloc-distrib --help" does not mention the --top option described in the man
page.
thanks,
--Guy
The short answer to this may be that my Nvidia driver is too old. My Nvidia
card is old so I have to use the version 173 proprietary driver on it, but the
latest nouveau driver works fine.
I'm on Fedora 18, testing hwloc-1.7. I fetched and built the latest
libXNVCtrl, 319.17, from
On 05/03/2013 04:13 PM, Brice Goglin wrote:
> If I remember correctly, NVIDIA or AMD proprietary drivers cannot use
> the kernel sysfs API because it's GPL-only. They can't create devices in
> sysfs, that's why hwloc doesn't get any GPU OS device with NVIDIA.
>
That sounds right and makes sense.
I'm getting the hwloc-1.7 version of the python bindings ready to go. I've
tried to add GL, Intel MIC, NVML, and CUDA support.
I can't implement much of CUDA or NVML for lack of python bindings for those
libraries, but I did what I could.
I can't test any of these for lack of hardware. If you have
On 06/04/2013 03:52 AM, Brice Goglin wrote:
> (forgot to CC the list)
>
>
> Le 04/06/2013 10:48, Brice Goglin a écrit :
>> Hello,
>>
>> Here are some slightly fixed tests. cuda/cudart/nvml look good.
>> intel-mic looks good but I couldn't test on a real machine (I used XML
>> instead), so the
On 06/05/2013 12:29 AM, Brice Goglin wrote:
> Le 05/06/2013 00:03, Guy Streeter a écrit :
...
>> I think my regular expression code is broken in the gl stuff. Do you have to
>> have the hardware and drivers for GL, or could I use an XML file for testing?
>>
I believe I have t
Partly to prepare for the eventual switch to python3, and partly for the
better refcount handling etc., I have rewritten python-hwloc and the requisite
python-libnuma in Cython.
The only drawback I've noticed with this change is that where python-hwloc
used to be backward-compatible with older
I am not able explain why this doesn't fail everywhere. If
HWLOC_PLUGINS_VERBOSE is not set, atoi() gets called with a NULL pointer, and
the behavior in that case is undocumented.
--Guy
>From 36a79abe46356ff360e192039fae3829b34b7997 Mon Sep 17 00:00:00 2001
From: Guy Streeter <stree...@redh
I'm doing that, but I'm not sure exactly what that means.
It fails in python-hwloc consistently on a Fedora 22 virtual machine, but not
at all on Fedora 21 on real hardware. (Those are my 2 test-cases)
--Guy
>
> Thanks, I'll apply this.
>
> Brice
>
>
>
> Le 09/10/2015 23:04, Guy St
ou!
>
>
> > On Sep 1, 2017, at 6:32 PM, Guy Streeter <guy.stree...@gmail.com> wrote:
> >
> > I'm still retired, but I found time to update python-hwloc for hwloc
> version 1.11.5, the version currently shipped in Fedora 26. I made some
> bug-fixes al
interested in seeing any changes, or have any
problems, in python-hwloc.
regards,
--Guy Streeter
___
hwloc-devel mailing list
hwloc-devel@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/hwloc-devel
I've made python-hwloc available to install through pip. It's a source
distribution, so development packages have to be installed first. I have
given instructions for Fedora 26 an 27 and Debian9 in the README.rst file
in the source tree.
See
47 matches
Mail list logo
