[Assimilation] Missing dependencies now available in official EPEL and Fedora 18/19

2013-07-16 Thread Jamie Nguyen
Hi,

These are the dependencies that were previously unavailable on RPM systems:

python-ctypesgen
python-py2neo (+ python3-py2neo)
python-testify

They are now all packaged and ready to install from the official
repositories.

However, one issue is the version of python-py2neo. I've packaged
version 1.5 which I gather assimilation is not yet compatible with.
Alan, what's the situation regarding py2neo? If there are significant
API changes, I can try to create a parallel installable python-py2neo14
package or something.

(NB: In my repository, the version of python-py2neo is 1.4.6 and the
assimilation packages conflict with newer versions, so you'll still be
able to install assimilation. You just have to do pass --skip-broken
every time you want to do a yum update.)

Kind regards,

-- 
Jamie Nguyen


___
Assimilation mailing list - Discovery-Driven Monitoring
Assimilation@lists.community.tummy.com
http://lists.community.tummy.com/cgi-bin/mailman/listinfo/assimilation
http://assimmon.org/


Re: [Assimilation] Missing dependencies now available in official EPEL and Fedora 18/19

2013-07-16 Thread Jamie Nguyen
On 16/07/13 10:40, Jamie Nguyen wrote:
 These are the dependencies that were previously unavailable on RPM systems:
 
 python-ctypesgen
 python-py2neo (+ python3-py2neo)
 python-testify
 
 They are now all packaged and ready to install from the official
 repositories.
 
 However, one issue is the version of python-py2neo. I've packaged
 version 1.5 which I gather assimilation is not yet compatible with.
 Alan, what's the situation regarding py2neo? If there are significant
 API changes, I can try to create a parallel installable python-py2neo14
 package or something.
 
 (NB: In my repository, the version of python-py2neo is 1.4.6 and the
 assimilation packages conflict with newer versions, so you'll still be
 able to install assimilation. You just have to do pass --skip-broken
 every time you want to do a yum update.)

Oh I forgot that neo4j is still only available in my repository, so not
quite all the dependencies are official yet, but almost there :-)

Kind regards,

-- 
Jamie Nguyen


___
Assimilation mailing list - Discovery-Driven Monitoring
Assimilation@lists.community.tummy.com
http://lists.community.tummy.com/cgi-bin/mailman/listinfo/assimilation
http://assimmon.org/


Re: [Assimilation] RPATH question as to SRPMs

2013-07-05 Thread Jamie Nguyen
On 02/07/13 21:00, R P Herrold wrote:
 On Tue, 2 Jul 2013, Jamie Nguyen wrote:
 
 I have just updated the SPEC and SRPM to version
 0.1.0-0.22.20130623hge529aa0d0e98

   http://jamielinux.fedorapeople.org/assimilation/SRPMS/
 
 testing in process
 
 I note the file shown at your archive is built without an externally
 visible EVR


Are you talking about the fact that the filename is
assimilation-cma.src.rpm instead of assimilation-cma-VERSION.src.rpm ?
That was a shortcut I took so that the latest SRPM/SPEC were always
available at the same link, but I've added the versioned files now too:

http://jamielinux.fedorapeople.org/assimilation/


-- 
Jamie Nguyen


___
Assimilation mailing list - Discovery-Driven Monitoring
Assimilation@lists.community.tummy.com
http://lists.community.tummy.com/cgi-bin/mailman/listinfo/assimilation
http://assimmon.org/


Re: [Assimilation] RPATH question as to SRPMs, more ...

2013-07-05 Thread Jamie Nguyen
On 02/07/13 22:21, R P Herrold wrote:
 On Tue, 2 Jul 2013, R P Herrold wrote:
 
 testing in process
 
 Sadly the new version fairy did not fix the rpath issue; I've drilled in
 the 'hard way' fix to a local .spec file and am testing further.  diff
 of the revised spec file sections at the end of this email
 
 That gets me past the RPATH issue, but there later seems to be a library
 issue as well:

Haven't been able to reproduce the library issue but will take a closer
look when I have time.

Thanks for looking into the rpath issue. I found a much easier way to
fix that with the -DCMAKE_SKIP_BUILD_RPATH=1 cmake flag while building,
which I'm hoping achieves pretty much the same thing (though my I only
have a rudimentary understanding of cmake).

http://jamielinux.fedorapeople.org/assimilation/


-- 
Jamie Nguyen


___
Assimilation mailing list - Discovery-Driven Monitoring
Assimilation@lists.community.tummy.com
http://lists.community.tummy.com/cgi-bin/mailman/listinfo/assimilation
http://assimmon.org/


[Assimilation] Errors when running CMA

2013-07-05 Thread Jamie Nguyen
Hi Alan,

I've not had much of a chance to debug, but on the latest packages I'm
getting this error when starting the CMA. Can you point me in the right
direction? I think it might be my fault somehow..

Jul  5 22:45:42 jab0 systemd[1]: Starting Collective Management
Authority (CMA) for Assimilation...
Jul  5 22:45:42 jab0 systemd[1]: Started Collective Management Authority
(CMA) for Assimilation.
Jul  5 22:45:42 jab0 cma[1399]: Traceback (most recent call last):
Jul  5 22:45:42 jab0 cma[1399]: File
/usr/lib64/python2.7/site-packages/assimilation/cma.py, line 290, in
module
Jul  5 22:45:42 jab0 cma[1399]: sys.exit(main())
Jul  5 22:45:42 jab0 cma[1399]: File
/usr/lib64/python2.7/site-packages/assimilation/cma.py, line 226, in main
Jul  5 22:45:42 jab0 cma[1399]: io = pyReliableUDP(config,
pyPacketDecoder(0))
Jul  5 22:45:42 jab0 cma[1399]: File
/usr/lib64/python2.7/site-packages/assimilation/AssimCclasses.py, line
1019, in __init__
Jul  5 22:45:42 jab0 cma[1399]: pyAssimObj.__init__(self, Cstruct=Cstruct)
Jul  5 22:45:42 jab0 cma[1399]: File
/usr/lib64/python2.7/site-packages/assimilation/AssimCclasses.py, line
346, in __init__
Jul  5 22:45:42 jab0 cma[1399]: assert type(Cstruct) is not int
Jul  5 22:45:42 jab0 cma[1399]: AssertionError
Jul  5 22:45:42 jab0 systemd[1]: assimilation-cma.service: main process
exited, code=exited, status=1/FAILURE
Jul  5 22:45:42 jab0 systemd[1]: Unit assimilation-cma.service entered
failed state.



-- 
Jamie Nguyen


___
Assimilation mailing list - Discovery-Driven Monitoring
Assimilation@lists.community.tummy.com
http://lists.community.tummy.com/cgi-bin/mailman/listinfo/assimilation
http://assimmon.org/


Re: [Assimilation] Just tagged RC4

2013-04-15 Thread Jamie Nguyen
On 15/04/13 00:08, Alan Robertson wrote:
 I just tagged 0.1.0-RC4 -- release candidate 4 for this first (0.1.0)
 release.

Hi Alan,

Builds fine on Fedora 18 but getting an error when building on CentOS 6.
Probably related to version of glib2 (2.22.5).


DEBUG: [ 64%] Building C object
clientlib/CMakeFiles/assimilationclientlib.dir/misc.c.o
DEBUG: cd
/builddir/build/BUILD/assimilation-20130414hg953f5c3a4e4b/build/clientlib 
/usr/lib/ccache/gcc  -Dassimilationclientlib_EXPORTS -O2 -g -pipe -Wall
-Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector
--param=ssp-buffer-size=4 -m32 -march=i686 -mtune=atom
-fasynchronous-unwind-tables  -g -fPIC
-I/builddir/build/BUILD/assimilation-20130414hg953f5c3a4e4b/include
-I/builddir/build/BUILD/assimilation-20130414hg953f5c3a4e4b/build/include 
-I/usr/include/glib-2.0
-I/usr/lib/glib-2.0/include-g -O2 -Werror -Wall -Wformat=2
-Wmissing-prototypes -Wmissing-declarations -Wstrict-prototypes
-Wdeclaration-after-statement -Wpointer-arith -Wwrite-strings
-Wcast-align -Winline -Wmissing-format-attribute -Wno-strict-aliasing
-funsigned-char -Wextra -Wstack-protector -Wformat-security
-D_FORTIFY_SOURCE=2 -o CMakeFiles/assimilationclientlib.dir/misc.c.o
-c
/builddir/build/BUILD/assimilation-20130414hg953f5c3a4e4b/clientlib/misc.c
DEBUG: cc1: warnings being treated as errors
DEBUG:
/builddir/build/BUILD/assimilation-20130414hg953f5c3a4e4b/clientlib/misc.c:
In function 'assim_merge_environ':
DEBUG:
/builddir/build/BUILD/assimilation-20130414hg953f5c3a4e4b/clientlib/misc.c:551:
error: implicit declaration of function 'g_get_environ'
DEBUG:
/builddir/build/BUILD/assimilation-20130414hg953f5c3a4e4b/clientlib/misc.c:551:
error: assignment makes pointer from integer without a cast


Kind regards,

-- 
Jamie Nguyen


___
Assimilation mailing list - Discovery-Driven Monitoring
Assimilation@lists.community.tummy.com
http://lists.community.tummy.com/cgi-bin/mailman/listinfo/assimilation
http://assimmon.org/


Re: [Assimilation] Just tagged RC4

2013-04-15 Thread Jamie Nguyen
On 15/04/13 18:11, Jamie Nguyen wrote:
 RPMS updated to 0.1.0-RC4 plus the above commit. Stuff in the usual places:
 
 Spec:
 http://jamielinux.fedorapeople.org/assimilation/assimilation.spec

Oops, that was meant to say:

Spec:
http://jamielinux.fedorapeople.org/assimilation/assimilation-cma.spec


Kind regards,

-- 
Jamie Nguyen


___
Assimilation mailing list - Discovery-Driven Monitoring
Assimilation@lists.community.tummy.com
http://lists.community.tummy.com/cgi-bin/mailman/listinfo/assimilation
http://assimmon.org/


Re: [Assimilation] Just tagged RC4

2013-04-15 Thread Jamie Nguyen
On 15/04/13 18:31, Alan Robertson wrote:
 OK.  I just /re/-tagged RC4 to include this patch.  Not an ideal
 circumstance, but seems more useful than the alternative...

Sorry I didn't get this in before you tagged!

-- 
Jamie Nguyen


___
Assimilation mailing list - Discovery-Driven Monitoring
Assimilation@lists.community.tummy.com
http://lists.community.tummy.com/cgi-bin/mailman/listinfo/assimilation
http://assimmon.org/


Re: [Assimilation] 0.1.0 Release Candidate 2 is out!

2013-03-27 Thread Jamie Nguyen
On 26/03/13 22:27, Jamie Nguyen wrote:
 On 26/03/13 21:49, Alan Robertson wrote:
 I don't see this problem on my systems...

 I'm running both of these systems from the pip-extracted versions of
 ctypesgen.py.  Don't know if it matters...

 Just to make sure, I removed the source I had, and re-extracted it and
 rebuilt it.  Same results.
 
 
 Hmm ok so I did a build outside of mock and it doesn't have the error,
 so it seems to be something different happening inside mock. Haven't
 quite figured out why this is the case, but I guess something to do with
 ctypesgen.


It appears the ordering of *.h files is the problem, which is related to
this line in buildtools/genpybindings.py:

  hdrfiles=os.listdir(includedir)


As I understand, the ordering of listdir is arbitrary (and things like
the filesystem affect it). Here are the orders I'm getting, the first
set is working and the second set is giving the parsing error.

[no errors]
 os.listdir('include')
['proj_classes.h', 'packetdecoder.h', 'compressframe.h', 'cryptframe.h',
'fsqueue.h', 'projectcommon.h.in', 'jsondiscovery.h', 'server_dump.h',
'hbsender.h', 'assimobj.h', 'listener.h', 'cmalib.h', 'nanoprobe.h',
'frameset.h', 'signframe.h', 'reliableudp.h', 'netio.h', 'seqnoframe.h',
'netaddr.h', 'pcap_min.h', 'address_family_numbers.h', 'pcap_GSource.h',
'addrframe.h', 'netgsource.h', 'generic_tlv_min.h', 'unknownframe.h',
'tlvhelper.h', 'hblistener.h', 'tlv_valuetypes.h', 'misc.h',
'intframe.h', 'discovery.h', 'configcontext.h', 'switchdiscovery.h',
'CMakeLists.txt', 'nvpairframe.h', 'cdp.h', 'cstringframe.h',
'netioudp.h', 'authlistener.h', 'ipportframe.h', 'frame.h',
'fsprotocol.h', 'lldp.h']


[parsing error]
 os.listdir('include')
['fsqueue.h', 'listener.h', 'packetdecoder.h', 'netaddr.h',
'nanoprobe.h', 'jsondiscovery.h', 'cstringframe.h', 'tlvhelper.h',
'hbsender.h', 'proj_classes.h', 'switchdiscovery.h', 'hblistener.h',
'configcontext.h', 'misc.h', 'authlistener.h', 'pcap_min.h',
'generic_tlv_min.h', 'addrframe.h', 'pcap_GSource.h',
'projectcommon.h.in', 'ipportframe.h', 'nvpairframe.h', 'netio.h',
'seqnoframe.h', 'unknownframe.h', 'assimobj.h', 'compressframe.h',
'signframe.h', 'intframe.h', 'reliableudp.h', 'fsprotocol.h',
'netgsource.h', 'cryptframe.h', 'cmalib.h', 'discovery.h', 'cdp.h',
'server_dump.h', 'netioudp.h', 'CMakeLists.txt', 'lldp.h',
'tlv_valuetypes.h', 'address_family_numbers.h', 'frameset.h', 'frame.h']



It would appear that certain orders cause problems, so I guess the fix
would be to either sort or specify an explicit order manually.

Manually writing the arguments for ctypesgen to match the order of
header files in the first set made the errors disappear. I also tried
just sorting them and the errors disappeared after I applied this patch:

--- a/buildtools/genpybindings.py
+++ b/buildtools/genpybindings.py
@@ -97,7 +97,7 @@
 #   Starting with the full pathname to glib.h
 args.append(findincfile(glibincdirs, glibheaderfile))
 # Add on the pathnames of all our header files
-hdrfiles=os.listdir(includedir)
+hdrfiles=sorted(os.listdir(includedir))
 hfileset={}
 for hfile in hdrfiles:
 if not hfile.endswith('.h'):



Kind regards,

-- 
Jamie Nguyen


___
Assimilation mailing list - Discovery-Driven Monitoring
Assimilation@lists.community.tummy.com
http://lists.community.tummy.com/cgi-bin/mailman/listinfo/assimilation
http://assimmon.org/


Re: [Assimilation] 0.1.0 Release Candidate 2 is out!

2013-03-26 Thread Jamie Nguyen
On 26/03/13 02:16, Alan Robertson wrote:
 I've just finished tagging RC2 for the first release (0.1.0) - WOOT WOOT!!
 The tag is v0.1.0-RC2.
 
 Jamie Nguyen has an RPM spec file for Fedora that you can find here:
 http://jamielinux.fedorapeople.org/assimilation/assimilation-cma.spec
 
 Jamie is pretty much overwhelmed with school (as he should be).  If he
 plays hooky enough to produce a set of SRPMs for 0.1.0-RC2, I'm sure
 he'll let us know.  But you can produce your own RPMs with is spec file.


RPMS updated to 0.1.0-RC2. Stuff in the usual places:

Spec:
http://jamielinux.fedorapeople.org/assimilation/assimilation.spec

SRPM:
http://jamielinux.fedorapeople.org/assimilation/SRPMS/assimilation-cma.src.rpm


Fedora 18 repository instructions:
http://repos.fedorapeople.org/repos/jamielinux/assimilation/fedora-assimilation.repo

RHEL/CentOS 6 repository instructions:
http://repos.fedorapeople.org/repos/jamielinux/assimilation/epel-assimilation.repo



I did notice a non-fatal error when building on both Fedora and RHEL,
though I don't think it affects running on Linux:

DEBUG: [ 83%] Generating ../../cma/AssimCtypes.py
DEBUG: cd
/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/build/clientlib 
python
/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/buildtools/genpybindings.py
/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/cma/AssimCtypes.py
/builddir/build/BUILD/assimilation-20130325hg36236b3560f2
/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/build
/builddir/build/BUILD
/assimilation-20130325hg36236b3560f2/build/clientlib
libassimilationclientlib
DEBUG: INFO: Status: Preprocessing /tmp/tmpbwcAZl.h
DEBUG: INFO: Status: gcc -E -DCTYPESGEN -D__signed__=signed -U __GNUC__
-dD -I/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/include
-I/usr/include/glib-2.0 -I/usr/lib64/glib-2.0/include
-I/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/include
-I/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/build/include 
-Dinline=
-D__inline__= -D__extension__= -D_Bool=uint8_t -D__const=const
-D__asm__(x)= -D__asm(x)= -DCTYPESGEN=1 /tmp/tmpbwcAZl.h
DEBUG: INFO: Status: Parsing /tmp/tmpbwcAZl.h
DEBUG: ERROR:
/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/include/proj_classes.h:42:
Syntax error at '*'
DEBUG: ERROR:
/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/include/proj_classes.h:42:
Syntax error at ')'
DEBUG: INFO: Status: Processing description list.
DEBUG: INFO: Status: Writing to
/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/cma/AssimCtypes.py.
DEBUG: INFO: Status: Wrapping complete.
DEBUG: make[2]: Leaving directory
`/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/build'
DEBUG: /usr/bin/cmake28 -E cmake_progress_report
/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/build/CMakeFiles
 48 49 50



-- 
Jamie Nguyen


___
Assimilation mailing list - Discovery-Driven Monitoring
Assimilation@lists.community.tummy.com
http://lists.community.tummy.com/cgi-bin/mailman/listinfo/assimilation
http://assimmon.org/


Re: [Assimilation] 0.1.0 Release Candidate 2 is out!

2013-03-26 Thread Jamie Nguyen
On 26/03/13 21:49, Alan Robertson wrote:
 On 03/26/2013 02:58 PM, Jamie Nguyen wrote:
 I did notice a non-fatal error when building on both Fedora and RHEL,
 though I don't think it affects running on Linux:
 It might very well (and probably does) affect the CMA.
 DEBUG: [ 83%] Generating ../../cma/AssimCtypes.py
 DEBUG: cd
 /builddir/build/BUILD/assimilation-20130325hg36236b3560f2/build/clientlib 
 python
 /builddir/build/BUILD/assimilation-20130325hg36236b3560f2/buildtools/genpybindings.py
 /builddir/build/BUILD/assimilation-20130325hg36236b3560f2/cma/AssimCtypes.py
 /builddir/build/BUILD/assimilation-20130325hg36236b3560f2
 /builddir/build/BUILD/assimilation-20130325hg36236b3560f2/build
 /builddir/build/BUILD
 /assimilation-20130325hg36236b3560f2/build/clientlib
 libassimilationclientlib
 DEBUG: INFO: Status: Preprocessing /tmp/tmpbwcAZl.h
 DEBUG: INFO: Status: gcc -E -DCTYPESGEN -D__signed__=signed -U __GNUC__
 -dD -I/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/include
 -I/usr/include/glib-2.0 -I/usr/lib64/glib-2.0/include
 -I/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/include
 -I/builddir/build/BUILD/assimilation-20130325hg36236b3560f2/build/include 
 -Dinline=
 -D__inline__= -D__extension__= -D_Bool=uint8_t -D__const=const
 -D__asm__(x)= -D__asm(x)= -DCTYPESGEN=1 /tmp/tmpbwcAZl.h
 DEBUG: INFO: Status: Parsing /tmp/tmpbwcAZl.h
 DEBUG: ERROR:
 /builddir/build/BUILD/assimilation-20130325hg36236b3560f2/include/proj_classes.h:42:
 Syntax error at '*'
 DEBUG: ERROR:
 /builddir/build/BUILD/assimilation-20130325hg36236b3560f2/include/proj_classes.h:42:
 Syntax error at ')'
 snip

 I don't see this problem on my systems...
 
 I'm running both of these systems from the pip-extracted versions of
 ctypesgen.py.  Don't know if it matters...
 
 Just to make sure, I removed the source I had, and re-extracted it and
 rebuilt it.  Same results.


Hmm ok so I did a build outside of mock and it doesn't have the error,
so it seems to be something different happening inside mock. Haven't
quite figured out why this is the case, but I guess something to do with
ctypesgen.


-- 
Jamie Nguyen


___
Assimilation mailing list - Discovery-Driven Monitoring
Assimilation@lists.community.tummy.com
http://lists.community.tummy.com/cgi-bin/mailman/listinfo/assimilation
http://assimmon.org/


Re: [Assimilation] Generating AssimCclasses.py: WAS Re: Preliminary RPM packages for Fedora 18 and EPEL 6

2013-03-15 Thread Jamie Nguyen
On 14/03/13 21:12, Alan Robertson wrote:
 Currently, AssimCctypes.py is a source file -- but it's really a file
 generated by ctypesgen.py.  I was trying to avoid everyone having to
 have a copy.
 
 But if you want to install somewhere other than /usr/lib/assimilation,
 then you need to run ctypesgen.  Everything else supports that - so this
 should too.
 
 Also, if you want to be able to have it locate the copy in your
 workspace, you also need to run ctypesgen.  And I definitely want to be
 able to do that if I can.
 
 So I have to make ctypesgen a required package - and generate two copies
 of AssimCtypes.py - one in my workspace, and one in the installed
 place.  Sigh...  And I have to run it automatically whenever I change
 any header file.  Additional sigh...
 
 But that seems to be a method which will work, and will satisfy all
 those issues. I wrote a python script which will do these things.  I'll
 finish it up, add the cmake rules, and commit it all this evening (or so
 I hope).

I spotted buildtools/genpybindings.py and it looks like it'll solve the
issues quite nicely. Just to make sure I'm using it right, can you give
an example of the options you might pass to it?


Kind regards,

-- 
Jamie Nguyen


___
Assimilation mailing list - Discovery-Driven Monitoring
Assimilation@lists.community.tummy.com
http://lists.community.tummy.com/cgi-bin/mailman/listinfo/assimilation
http://assimmon.org/