[hwloc-devel] python bindings for libhwloc?

2010-11-19 Thread Guy Streeter
Has anyone worked on or expressed interest in python bindings for the hwloc library? I do most of my work in python and would find it useful. I threw together a python implementation of the hwloc-hello program in python, using ctypes to access the library. It was fairly straight-forward. I

Re: [hwloc-devel] SWIG bindings

2010-11-30 Thread Guy Streeter
On 11/30/2010 10:52 AM, Jeff Squyres wrote: On Nov 30, 2010, at 11:44 AM, Guy Streeter wrote: Would anyone object if I take a whack at making some SWIG bindings for hwloc? I'm thinking specifically for perl (because that's my scripting language of choice), but I could probably be convinced

Re: [hwloc-devel] Hwloc perl binding

2010-12-15 Thread Guy Streeter
On 12/15/2010 02:02 PM, Brice Goglin wrote: ... As I said, we're trying to keep things consistent. My understanding is that a function should have a topology parameter if it traverses some links between objects inside the topology. If it only operates on a given object and does not traverse the

Re: [hwloc-devel] 1.0.3rc3 and 1.1rc5

2010-12-20 Thread Guy Streeter
On 12/20/2010 12:56 PM, Brice Goglin wrote: Le 20/12/2010 19:40, Guy Streeter a écrit : Get this singlethreaded process memory : expected 0x000f, got 0xf...f Is that a bug? That's on my Fedora 13 non-numa system. This is kind of expected. 0x000f means all the cores in the machine

Re: [hwloc-devel] 1.0.3rc3 and 1.1rc5

2010-12-20 Thread Guy Streeter
On 12/20/2010 12:56 PM, Brice Goglin wrote: Le 20/12/2010 19:40, Guy Streeter a écrit : Get this singlethreaded process memory : expected 0x000f, got 0xf...f Is that a bug? That's on my Fedora 13 non-numa system. This is kind of expected. 0x000f means all the cores in the machine

Re: [hwloc-devel] [hwloc-svn] svn:hwloc r2975

2010-12-22 Thread Guy Streeter
On 12/22/2010 02:36 AM, Brice Goglin wrote: I'll backport this in 1.1 later, in case somebody wants to fix the English speaking. Brice For the benefit of the Perl and Python bindings efforts, it would be good if we could query the runtime library for it's API version. --Guy Le

Re: [hwloc-devel] [hwloc-svn] svn:hwloc r2975

2010-12-22 Thread Guy Streeter
On 12/22/2010 09:02 AM, Brice Goglin wrote: Le 22/12/2010 15:59, Guy Streeter a écrit : On 12/22/2010 02:36 AM, Brice Goglin wrote: I'll backport this in 1.1 later, in case somebody wants to fix the English speaking. Brice For the benefit of the Perl and Python bindings efforts, it would

[hwloc-devel] Is hwloc_bitmap_from_ith_ulong working?

2010-12-22 Thread Guy Streeter
I'm using 1.1 on Fedora 13. I start with set = hwloc_bitmap_alloc_full() and it looks like 0xf...f Then I call hwloc_bitmap_from_ith_ulong(set, 1, 0xdeadbeef) and I get 0xdeadbeef,0x0034,0x3f77aed8 which I don't understand. Example code is attached. thanks, --Guy #include #include

Re: [hwloc-devel] Is hwloc_bitmap_from_ith_ulong working?

2010-12-22 Thread Guy Streeter
On 12/22/2010 01:50 PM, Guy Streeter wrote: I'm using 1.1 on Fedora 13. I start with set = hwloc_bitmap_alloc_full() and it looks like 0xf...f Then I call hwloc_bitmap_from_ith_ulong(set, 1, 0xdeadbeef) and I get 0xdeadbeef,0x0034,0x3f77aed8 which I don't understand. Example code

[hwloc-devel] python bindings

2011-01-17 Thread Guy Streeter
I am currently working to get a public git repository set up so that I can share the work. In the meantime, my first pass at python bindings for hwloc are available from http://people.redhat.com/streeter/ There are rpm files and a source tarball there. The tarball has implementations of some

Re: [hwloc-devel] python bindings

2011-01-20 Thread Guy Streeter
On 01/20/2011 11:32 AM, Samuel Thibault wrote: Hello, Guy Streeter, le Mon 17 Jan 2011 21:03:04 +0100, a écrit : I am currently working to get a public git repository set up so that I can share the work. In the meantime, my first pass at python bindings for hwloc are available from http

Re: [hwloc-devel] python bindings

2011-01-20 Thread Guy Streeter
On 01/20/2011 01:22 PM, Samuel Thibault wrote: Bernd Kallies, le Thu 20 Jan 2011 20:13:03 +0100, a écrit : The only thing I was wondering about are these OO method names, which I had to invent them myself. If there is some need to synchronize these with the python binding, we may agree about

[hwloc-devel] git repo for python bindings

2011-01-21 Thread Guy Streeter
The python bindings are now available at http://git.fedorahosted.org/git/python-hwloc.git or git://git.fedorahosted.org/python-hwloc.git --Guy

Re: [hwloc-devel] git repo for python bindings

2011-02-01 Thread Guy Streeter
On 01/21/2011 10:48 AM, Guy Streeter wrote: The python bindings are now available at http://git.fedorahosted.org/git/python-hwloc.git or git://git.fedorahosted.org/python-hwloc.git --Guy I have significantly updated the python bindings implementation: Renamed the classes; Topology, Obj

[hwloc-devel] typo in hwloc-bind.c

2011-02-09 Thread Guy Streeter
else if (!strncmp(argv[1], "interleace", 2)) should be else if (!strncmp(argv[1], "interleave", 2)) --Guy

[hwloc-devel] arbitrary length limit in attr_snprintf

2011-02-21 Thread Guy Streeter
The output of hwloc_obj_attr_snprintf() is arbitrarily limited. In particular, the infos portion is at most 255 characters long. On my systems there is quite a bit more in the infos for the machine object. --Guy

[hwloc-devel] multiple simultaneous topology inits?

2011-02-28 Thread Guy Streeter
I was considering the design of an administration tool in python, and my original idea was to have each module that needs the topology object create its own. This means that different parts of the same program (but possibly in different threads) would call init and load on their own topology

[hwloc-devel] set_synthetic documentation error

2011-04-01 Thread Guy Streeter
The man page and the online documentation for hwloc_topology_set_synthetic() both say that it takes a comma-separated list as input. It appears to take a space-separated list instead. Also, the documentation does not indicate what the return value means. When the input description cannot be

[hwloc-devel] python bindings for hwloc 1.2

2011-05-19 Thread Guy Streeter
I have updated the python bindings to support hwloc-1.2. They are backward-compatible with 1.1. There is a Fedora rpm and a tarball on http://people.redhat.com/streeter/ and the git archive is git://git.fedorahosted.org/python-hwloc.git ssh://git.fedorahosted.org/git/python-hwloc.git

Re: [hwloc-devel] hwloc trunk nightly 1.3a1r3511 fails to build on CentOS 5.6 & RHEL 5.6

2011-06-17 Thread Guy Streeter
pciutils was re-based to 3.1.7 in RHEL5.6 at the request of some of our hardware partners, in order to add some new hardware support. That'd explain why I didn't hit it when I was testing previously, we were still on CentOS 5.4 and RHEL 5.5 then so obviously this dependency is new in RHEL

Re: [hwloc-devel] final v1.3?

2011-10-11 Thread Guy Streeter
On 10/11/2011 01:59 AM, Brice Goglin wrote: Anybody against releasing the final v1.3? We only had the following changes since v1.3rc2. Nothing worth a new tarball? * Fix lstopo crash in verbose messages about offline/disallowed/... processors when root has no cpuset, just don't display anything

[hwloc-devel] memory corruption problem with libpci

2011-11-03 Thread Guy Streeter
I have a RHEL6.1 system on which I get a glibc error report: *** glibc detected *** hwloc-1.3/bin/lstopo: double free or corruption (!prev): 0x01945630 *** === Backtrace: = /lib64/libc.so.6[0x3d1a275716] /lib64/libpci.so.3[0x3d1aa06bdf]

Re: [hwloc-devel] memory corruption problem with libpci

2011-11-03 Thread Guy Streeter
On 11/03/2011 12:51 PM, Guy Streeter wrote: > I have a RHEL6.1 system on which I get a glibc error report: > > *** glibc detected *** hwloc-1.3/bin/lstopo: double free or corruption > (!prev): 0x01945630 *** > === Backtrace: = > /lib64/libc.so.6[0x3d

[hwloc-devel] understanding PCI device to NUMA node connection

2011-11-28 Thread Guy Streeter
This question may be more about understanding NUMA (which I barely do) than about hwloc, but perhaps you can help anyway. I have a customer with some HP Proliant DL580 G7 servers. HP supplied them with a block diagram of their system, and it shows two of the NUMA nodes connected to the PCI

Re: [hwloc-devel] understanding PCI device to NUMA node connection

2011-11-28 Thread Guy Streeter
On 11/28/2011 03:45 PM, Brice Goglin wrote: ... > Current Intel platforms have 2 QPI links going to I/O hubs. Most servers > with many sockets (4 or more) thus have each I/O hub connected to only 2 > processors directly, so their distance is "equal" as you say. > > However, some BIOS report

Re: [hwloc-devel] lstopo-nox strikes back

2012-04-25 Thread Guy Streeter
On 04/25/2012 04:38 AM, Brice Goglin wrote: > Hello, > > We recently got some complains from redhat/centos users that wanted to install > hwloc on their cluster but couldn't because it brought so many X libraries > that they don't care about. > > Debian solves this by having two hwloc packages:

[hwloc-devel] python bindings updated for hwloc 1.5 (also, python-libnuma is available)

2012-09-25 Thread Guy Streeter
I have updated python-hwloc to support version 1.5 of hwloc. It is available at git://git.fedorahosted.org/python-hwloc.git as well as rpm packages and source tarball on http://people.redhat.com/streeter/ In the course of this, I added the linux_libnuma calls. python-hwloc now depends on

[hwloc-devel] Why doesn't my disk controller show up?

2012-10-09 Thread Guy Streeter
I'm trying to understand why for one of my systems the disk controller is not shown as an OS device. The PCI device is seen, but there is no OS device under it. It's a SATA controller emulated as SCSI, It think. gather-topology output is attached. Using hwloc 1.5 on Fedora 17. thanks, --Guy

Re: [hwloc-devel] Why doesn't my disk controller show up?

2012-10-09 Thread Guy Streeter
On 10/09/2012 02:03 PM, Brice Goglin wrote: > Le 09/10/2012 20:47, Guy Streeter a écrit : >> I'm trying to understand why for one of my systems the disk controller is not >> shown as an OS device. The PCI device is seen, but there is no OS device >> under >> it. It's

Re: [hwloc-devel] Why doesn't my disk controller show up?

2012-10-09 Thread Guy Streeter
On 10/09/2012 02:18 PM, Guy Streeter wrote: > On 10/09/2012 02:03 PM, Brice Goglin wrote: >> Le 09/10/2012 20:47, Guy Streeter a écrit : >>> I'm trying to understand why for one of my systems the disk controller is >>> not >>> shown as an OS device. The PC

Re: [hwloc-devel] Why doesn't my disk controller show up?

2012-10-09 Thread Guy Streeter
On 10/09/2012 03:12 PM, Brice Goglin wrote: > Le 09/10/2012 22:12, Brice Goglin a écrit : >> The attached patch should help (and fix minor bugs nearby). >> >> Brice >> > > Patch attached for real. > > Yep, works fine. Thanks for the fast response! --Guy

[hwloc-devel] non-PCI OS devices?

2012-10-15 Thread Guy Streeter
When I'm trying to visualize how my system is physically configured, in order to decide how best to bind applications, I'd like to know about every source of interrupts. keyboard and mouse, timers, sound, USB-connected devices, etc. Has any though been given to expanding the OS device information

[hwloc-devel] CPU affinity of OS Devices?

2012-11-06 Thread Guy Streeter
I noticed on my system (Fedora 17) that the OS Devices don't have their own cpuset. It seems like it would be good to know the affinity of the interrupt assigned to the device. Is there a provision for this in hwloc, or would I need to find it another way? thanks, --Guy

Re: [hwloc-devel] CPU affinity of OS Devices?

2012-11-06 Thread Guy Streeter
On 11/06/2012 03:53 PM, Brice Goglin wrote: > Hello Guy, > > I don't think OS devices ever had a cpuset. All objects that are not > things where you can bind processes usually have NULL cpusets. So when > you have a PCI or OS device, you walk up the obj->parent pointer until > you find an object

Re: [hwloc-devel] CPU affinity of OS Devices?

2012-11-07 Thread Guy Streeter
On 11/06/2012 05:20 PM, Brice Goglin wrote: > Le 06/11/2012 23:55, Guy Streeter a écrit : >> On 11/06/2012 03:53 PM, Brice Goglin wrote: >>> Hello Guy, >>> >>> I don't think OS devices ever had a cpuset. All objects that are not >>> things where you can

[hwloc-devel] python bindings updated to 1.6

2013-01-04 Thread Guy Streeter
I have finally made the 1.6 additions to python-hwloc. userdata and xml import/export od userdata works. I spent some time trying to find a way to let userdata be a reference to a python object, but in the end decided to leave associating the userdata value with data in python space up to the

[hwloc-devel] manpage / --help discrepancies

2013-03-20 Thread Guy Streeter
"hwloc-assembler-remote --help" shows a --force option not mentioned in the man-page. The man page documents a --verbose option not recognized by the command. "hwloc-distrib --help" does not mention the --top option described in the man page. thanks, --Guy

[hwloc-devel] nvidia and nouveau driver differences

2013-05-03 Thread Guy Streeter
The short answer to this may be that my Nvidia driver is too old. My Nvidia card is old so I have to use the version 173 proprietary driver on it, but the latest nouveau driver works fine. I'm on Fedora 18, testing hwloc-1.7. I fetched and built the latest libXNVCtrl, 319.17, from

Re: [hwloc-devel] nvidia and nouveau driver differences

2013-05-03 Thread Guy Streeter
On 05/03/2013 04:13 PM, Brice Goglin wrote: > If I remember correctly, NVIDIA or AMD proprietary drivers cannot use > the kernel sysfs API because it's GPL-only. They can't create devices in > sysfs, that's why hwloc doesn't get any GPU OS device with NVIDIA. > That sounds right and makes sense.

[hwloc-devel] python bindings testing help needed

2013-06-03 Thread Guy Streeter
I'm getting the hwloc-1.7 version of the python bindings ready to go. I've tried to add GL, Intel MIC, NVML, and CUDA support. I can't implement much of CUDA or NVML for lack of python bindings for those libraries, but I did what I could. I can't test any of these for lack of hardware. If you have

Re: [hwloc-devel] python bindings testing help needed

2013-06-04 Thread Guy Streeter
On 06/04/2013 03:52 AM, Brice Goglin wrote: > (forgot to CC the list) > > > Le 04/06/2013 10:48, Brice Goglin a écrit : >> Hello, >> >> Here are some slightly fixed tests. cuda/cudart/nvml look good. >> intel-mic looks good but I couldn't test on a real machine (I used XML >> instead), so the

Re: [hwloc-devel] python bindings testing help needed

2013-06-05 Thread Guy Streeter
On 06/05/2013 12:29 AM, Brice Goglin wrote: > Le 05/06/2013 00:03, Guy Streeter a écrit : ... >> I think my regular expression code is broken in the gl stuff. Do you have to >> have the hardware and drivers for GL, or could I use an XML file for testing? >> I believe I have t

[hwloc-devel] cython re-write of python-hwloc

2014-01-07 Thread Guy Streeter
Partly to prepare for the eventual switch to python3, and partly for the better refcount handling etc., I have rewritten python-hwloc and the requisite python-libnuma in Cython. The only drawback I've noticed with this change is that where python-hwloc used to be backward-compatible with older

[hwloc-devel] Check the return value of getenv() in, hwloc_plugin_check_namespace

2015-10-09 Thread Guy Streeter
I am not able explain why this doesn't fail everywhere. If HWLOC_PLUGINS_VERBOSE is not set, atoi() gets called with a NULL pointer, and the behavior in that case is undocumented. --Guy >From 36a79abe46356ff360e192039fae3829b34b7997 Mon Sep 17 00:00:00 2001 From: Guy Streeter <stree...@redh

Re: [hwloc-devel] Check the return value of getenv() in, hwloc_plugin_check_namespace

2015-10-09 Thread Guy Streeter
I'm doing that, but I'm not sure exactly what that means. It fails in python-hwloc consistently on a Fedora 22 virtual machine, but not at all on Fedora 21 on real hardware. (Those are my 2 test-cases) --Guy > > Thanks, I'll apply this. > > Brice > > > > Le 09/10/2015 23:04, Guy St

Re: [hwloc-devel] Python bindings for hwloc

2017-09-20 Thread Guy Streeter
ou! > > > > On Sep 1, 2017, at 6:32 PM, Guy Streeter <guy.stree...@gmail.com> wrote: > > > > I'm still retired, but I found time to update python-hwloc for hwloc > version 1.11.5, the version currently shipped in Fedora 26. I made some > bug-fixes al

[hwloc-devel] Python bindings for hwloc

2017-09-01 Thread Guy Streeter
interested in seeing any changes, or have any problems, in python-hwloc. regards, --Guy Streeter ___ hwloc-devel mailing list hwloc-devel@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/hwloc-devel

[hwloc-devel] python-hwloc available via pip install

2018-01-03 Thread Guy Streeter
I've made python-hwloc available to install through pip. It's a source distribution, so development packages have to be installed first. I have given instructions for Fedora 26 an 27 and Debian9 in the README.rst file in the source tree. See