Re: NEW: sysutils/riemann
On Tue, Dec 20, 2016 at 10:06:24PM +, Stuart Henderson wrote: > On 2016/12/21 00:42, Pavel Korovin wrote: > > On 12/20, Stuart Henderson wrote: > > > > > There are a couple of "/etc/riemann.config", /etc should be replaced > > > with ${SYSCONFDIR} one way or another (either via SUBST_CMD or a simple > > > sed -i). > > > > Fixed. > > One more in the rc script; fixed one attached. > > This version is OK sthen@ to import if somebody would like to do that > (if they don't find something else to tweak :) imported, thanks pavel! Landry
Re: NEW: sysutils/riemann
On 2016/12/21 00:42, Pavel Korovin wrote: > On 12/20, Stuart Henderson wrote: > > > There are a couple of "/etc/riemann.config", /etc should be replaced > > with ${SYSCONFDIR} one way or another (either via SUBST_CMD or a simple > > sed -i). > > Fixed. One more in the rc script; fixed one attached. This version is OK sthen@ to import if somebody would like to do that (if they don't find something else to tweak :) > +786 _riemann _riemannsysutils/riemann Committed. riemann.tgz Description: application/tar-gz
Re: NEW: sysutils/riemann
Oops, my bad: uid 785 was just reserved for _uucp. The updated port/patch attached. Sorry for the noise. -- With best regards, Pavel Korovin riemann.tar.gz Description: application/tar-gz Index: user.list === RCS file: /cvs/ports/infrastructure/db/user.list,v retrieving revision 1.287 diff -u -p -r1.287 user.list --- user.list 18 Dec 2016 19:48:29 - 1.287 +++ user.list 20 Dec 2016 21:45:59 - @@ -294,3 +294,4 @@ id usergroup port options 783 _rmilter _rmiltermail/rmilter 784 _hping _hping net/hping 785 _uucp _uucp net/uucp +786 _riemann _riemannsysutils/riemann
Re: NEW: sysutils/riemann
On 12/20, Stuart Henderson wrote: > There are a couple of "/etc/riemann.config", /etc should be replaced > with ${SYSCONFDIR} one way or another (either via SUBST_CMD or a simple > sed -i). Fixed. > Similarly /var/log should be ${LOCALSTATEDIR}/log. > > PLIST should have the next free uid from ports/infrastructure/db/user.list, Fixed, the next free uid/gid 785, patch for user.list attached. > And the @extraunexec is a bit wrong, you have > > @extraunexec rmdir -rf /var/log/riemann > > - should probably be > > @extraunexec rm -rf /var/log/riemann/* Fixed. Please see the updated port attached. -- With best regards, Pavel Korovin riemann.tar.gz Description: application/tar-gz Index: infrastructure/db/user.list === RCS file: /cvs/ports/infrastructure/db/user.list,v retrieving revision 1.285 diff -u -p -r1.285 user.list --- infrastructure/db/user.list 5 Dec 2016 13:58:14 - 1.285 +++ infrastructure/db/user.list 20 Dec 2016 21:35:41 - @@ -293,3 +293,4 @@ id usergroup port options 782 _ympd _ympd audio/ympd 783 _rmilter _rmiltermail/rmilter 784 _hping _hping net/hping +785 _riemann _riemannsysutils/riemann
Re: NEW: sysutils/riemann
On 2016/12/20 22:21, Pavel Korovin wrote: > Hi all, > > Yet another try to add sysutils/riemann port. May be this time I'll be lucky. > > Riemann is an event processor which gets events from various inputs, > aggregates/analyses/filters/processes them and sends the results to some > output. > I'm using it for more than two years for different purposes and found it very > useful. > For example, I monitor temperature sensors from various devices in the > datacenter. Modern devices have many sensors and any temperature fluctuation > can indicate fauilure of some of the system's components. > > Riemann helps to monitor not the absolute values, but the rate of changes. > I.e. if the temperature value from any sensor rises two or more times > above average for more than 1 degree during 10 minutes, I'll get a > notification. > It works so well that I can see if the technician enters the room and stays > long enough in the hot corridor behind the rack: I'm getting the alert > in this case. Some other uses: CPU/load; disk/network IO; filesystem > usage monitoring. It can also be used as a homegrown IDS/IPS, like this: if > the system keeps getting an increasing number of events from the given > IP address, then do something about it (block, tarpit, alert, strike back, > etc). > > -- > With best regards, > Pavel Korovin There are a couple of "/etc/riemann.config", /etc should be replaced with ${SYSCONFDIR} one way or another (either via SUBST_CMD or a simple sed -i). Similarly /var/log should be ${LOCALSTATEDIR}/log. PLIST should have the next free uid from ports/infrastructure/db/user.list, And the @extraunexec is a bit wrong, you have @extraunexec rmdir -rf /var/log/riemann - should probably be @extraunexec rm -rf /var/log/riemann/* Otherwise looks ok, not tested though (I already have one java thingy running on my workstation, I don't think I have enough memory for another ;)
NEW: sysutils/riemann
Hi all, Yet another try to add sysutils/riemann port. May be this time I'll be lucky. Riemann is an event processor which gets events from various inputs, aggregates/analyses/filters/processes them and sends the results to some output. I'm using it for more than two years for different purposes and found it very useful. For example, I monitor temperature sensors from various devices in the datacenter. Modern devices have many sensors and any temperature fluctuation can indicate fauilure of some of the system's components. Riemann helps to monitor not the absolute values, but the rate of changes. I.e. if the temperature value from any sensor rises two or more times above average for more than 1 degree during 10 minutes, I'll get a notification. It works so well that I can see if the technician enters the room and stays long enough in the hot corridor behind the rack: I'm getting the alert in this case. Some other uses: CPU/load; disk/network IO; filesystem usage monitoring. It can also be used as a homegrown IDS/IPS, like this: if the system keeps getting an increasing number of events from the given IP address, then do something about it (block, tarpit, alert, strike back, etc). -- With best regards, Pavel Korovin riemann.tar.gz Description: application/tar-gz
Re: [UPDATE] sysutils/collectd + [NEW] sysutils/riemann-c-client
On 11/28, Landry Breuil wrote: > Pretty sure i had no riemann installed, that was on my work desktop, > will have to check tmrw. Either way, we should set NO_TEST=Yes if we > dont really know the right requirements and nobody wants to spend time > into doing this properly, or... do it properly :) Landry, for testing it requires 1) libcheck (devel/check) installed; 2) riemann running with the test configuration supplied with riemann-c-client. Since we don't have riemann in the first place (though I'd be happy to post it n'th time to ports@ if anybody have any interest), let's leave it with NO_TEST. -- With best regards, Pavel Korovin sysutils_riemann-c-client.tgz Description: application/tar-gz
Re: [UPDATE] sysutils/collectd + [NEW] sysutils/riemann-c-client
On Mon, Nov 28, 2016 at 10:39:32PM +0300, Pavel Korovin wrote: > On 11/27, Landry Breuil wrote: > > Finally got around testing this, and saw the same things. But if you run > > the check_libriemann manually, you get this: > > > > $ktrace tests/check_libriemann > > Running suite(s): Riemann C client library tests > > 97%: Checks: 37, Failures: 0, Errors: 1 > > tests/check_client.c:29:E:Client:test_riemann_client_connect:0: (after > > this point) Test timeout expired > > > > So something about fd redirections or workdir ? > > > > Is sysutils/ the right directory for such a client library ? > > > Hi Landry, > > I suppose you have libcheck installed, because I don't even have test target > available without it. > And it seems that check target requires riemann, do you have it installed? Pretty sure i had no riemann installed, that was on my work desktop, will have to check tmrw. Either way, we should set NO_TEST=Yes if we dont really know the right requirements and nobody wants to spend time into doing this properly, or... do it properly :) Landry
Re: [UPDATE] sysutils/collectd + [NEW] sysutils/riemann-c-client
On 11/27, Landry Breuil wrote: > Finally got around testing this, and saw the same things. But if you run > the check_libriemann manually, you get this: > > $ktrace tests/check_libriemann > Running suite(s): Riemann C client library tests > 97%: Checks: 37, Failures: 0, Errors: 1 > tests/check_client.c:29:E:Client:test_riemann_client_connect:0: (after > this point) Test timeout expired > > So something about fd redirections or workdir ? > > Is sysutils/ the right directory for such a client library ? Hi Landry, I suppose you have libcheck installed, because I don't even have test target available without it. And it seems that check target requires riemann, do you have it installed? -- With best regards, Pavel Korovin
Re: [UPDATE] sysutils/collectd + [NEW] sysutils/riemann-c-client
On Tue, Nov 15, 2016 at 10:25:05AM +, Stuart Henderson wrote: > On 2016/11/15 11:05, Landry Breuil wrote: > > On Mon, Nov 14, 2016 at 08:34:34PM +0300, Pavel Korovin wrote: > > > Sorry, forgot to cvs delete before diff. > > > The correct diff for sysutils/collectd attached. > > > > Nice work! If someone can ok the riemann-c client port, i'll try to test > > & commit this in the coming days. > > > > Landry > > > > I'm seeing this from port-lib-depends-check, > > riemann-c-client-1.9.1(sysutils/riemann-c-client): > Extra: m.10 stdc++.57 > > Tests need a patch-Makefile_am to remove -ldl, but then they seem to hang > burning cpu without making any syscalls: > > $OpenBSD$ > --- Makefile.am.orig Tue Nov 15 10:18:56 2016 > +++ Makefile.am Tue Nov 15 10:19:10 2016 > @@ -83,7 +83,7 @@ AM_TESTS_ENVIRONMENT= \ > TESTS_ENVIRONMENT?= ${AM_TESTS_ENVIRONMENT} > > tests/check_%: CFLAGS += ${CHECK_CFLAGS} > -tests/check_%: LDADD += ${CHECK_LIBS} -ldl > +tests/check_%: LDADD += ${CHECK_LIBS} > tests/check_%: LDFLAGS += -no-install > > check_PROGRAMS = ${TESTS} Finally got around testing this, and saw the same things. But if you run the check_libriemann manually, you get this: $ktrace tests/check_libriemann Running suite(s): Riemann C client library tests 97%: Checks: 37, Failures: 0, Errors: 1 tests/check_client.c:29:E:Client:test_riemann_client_connect:0: (after this point) Test timeout expired So something about fd redirections or workdir ? Is sysutils/ the right directory for such a client library ? Landry
Re: [UPDATE] sysutils/collectd + [NEW] sysutils/riemann-c-client
On 2016/11/15 11:05, Landry Breuil wrote: > On Mon, Nov 14, 2016 at 08:34:34PM +0300, Pavel Korovin wrote: > > Sorry, forgot to cvs delete before diff. > > The correct diff for sysutils/collectd attached. > > Nice work! If someone can ok the riemann-c client port, i'll try to test > & commit this in the coming days. > > Landry > I'm seeing this from port-lib-depends-check, riemann-c-client-1.9.1(sysutils/riemann-c-client): Extra: m.10 stdc++.57 Tests need a patch-Makefile_am to remove -ldl, but then they seem to hang burning cpu without making any syscalls: $OpenBSD$ --- Makefile.am.origTue Nov 15 10:18:56 2016 +++ Makefile.am Tue Nov 15 10:19:10 2016 @@ -83,7 +83,7 @@ AM_TESTS_ENVIRONMENT = \ TESTS_ENVIRONMENT ?= ${AM_TESTS_ENVIRONMENT} tests/check_%: CFLAGS += ${CHECK_CFLAGS} -tests/check_%: LDADD += ${CHECK_LIBS} -ldl +tests/check_%: LDADD += ${CHECK_LIBS} tests/check_%: LDFLAGS += -no-install check_PROGRAMS = ${TESTS}
Re: [UPDATE] sysutils/collectd + [NEW] sysutils/riemann-c-client
On 11/15, Landry Breuil wrote: > Nice work! If someone can ok the riemann-c client port, i'll try to test > & commit this in the coming days. Landry, regarding testing it with Riemann/graphite, I have it in production for a long time, I eat my own dog food in this case. It's a pity nobody have any interest in Riemann port and some other ports I keep posting to ports@... I hate to have uncommitted stuff in $mystuff. -- With best regards, Pavel Korovin
Re: [UPDATE] sysutils/collectd + [NEW] sysutils/riemann-c-client
On Mon, Nov 14, 2016 at 08:34:34PM +0300, Pavel Korovin wrote: > Sorry, forgot to cvs delete before diff. > The correct diff for sysutils/collectd attached. Nice work! If someone can ok the riemann-c client port, i'll try to test & commit this in the coming days. Landry
[UPDATE] sysutils/collectd + [NEW] sysutils/riemann-c-client
Dear all, Please find the update for sysutils/collectd to v5.6.1 attached. Since the write_riemann plugin requires riemann-c-client library (the change was introduced in collectd-5.6.0), the new port for sysutils/riemann-c-client is also attached. Tested on amd64. -- With best regards, Pavel Korovin Index: Makefile === RCS file: /cvs/ports/sysutils/collectd/Makefile,v retrieving revision 1.40 diff -u -p -r1.40 Makefile --- Makefile7 Nov 2016 10:51:36 - 1.40 +++ Makefile14 Nov 2016 17:00:04 - @@ -9,10 +9,9 @@ COMMENT-virt = collectd libvirt plugin COMMENT-python = collectd python plugin COMMENT-memcachec =collectd memcachec plugin COMMENT-nut = collectd nut plugin +COMMENT-riemann = collectd riemann plugin -V =5.5.1 -REVISION-main =0 -REVISION-virt =1 +V =5.6.1 DISTNAME = collectd-$V PKGNAME-main = collectd-$V PKGNAME-mysql =collectd-mysql-$V @@ -23,6 +22,7 @@ PKGNAME-virt =collectd-virt-$V PKGNAME-python = collectd-python-$V PKGNAME-memcachec =collectd-memcachec-$V PKGNAME-nut = collectd-nut-$V +PKGNAME-riemann = collectd-riemann-$V CATEGORIES = sysutils HOMEPAGE = http://www.collectd.org/ @@ -32,11 +32,13 @@ SHARED_LIBS += collectdclient 1.0 PERMIT_PACKAGE_CDROM = Yes MASTER_SITES = ${HOMEPAGE}/files/ +EXTRACT_SUFX = .tar.bz2 MODULES = devel/gettext lang/python MODPY_RUNDEP = No -MULTI_PACKAGES = -main -mysql -pgsql -rrdtool -snmp -virt -python -memcachec -nut +MULTI_PACKAGES = -main -mysql -pgsql -rrdtool -snmp -virt -python -memcachec -nut -riemann + WANTLIB-mysql =crypto m ssl z mysqlclient_r pthread LIB_DEPENDS-mysql =databases/mariadb @@ -78,6 +80,11 @@ LIB_DEPENDS-nut =nut->=2.7.3p0:sysutils RUN_DEPENDS-nut = collectd-$V:${BASE_PKGPATH},-main WANTLIB-nut = crypto pthread ssl upsclient +LIB_DEPENDS-riemann = sysutils/riemann-c-client +WANTLIB-riemann = c gmp gnutls ffi hogweed intl iconv idn json-c m \ + nettle protobuf p11-kit pthread riemann-client stdc++ tasn1 z +RUN_DEPENDS-riemann = collectd-$V:${BASE_PKGPATH},-main + LIB_DEPENDS += net/curl \ net/liboping \ textproc/libxml \ @@ -99,7 +106,7 @@ CONFIGURE_ARGS +=--with-ltdl-include=${L --with-ltdl-lib=${LOCALBASE}/lib \ --with-librrd=${LOCALBASE} \ --with-libstatgrab=${LOCALBASE} \ - --with-libnetsnmp=${LOCALBASE}/bin/net-snmp-config \ + --with-libnetsnmp=${LOCALBASE} \ --with-python=${MODPY_BIN} \ --enable-all-plugins=no @@ -117,12 +124,14 @@ ENABLED_PLUGINS = apache apcups ascent b users uuid write_http write_graphite pf python virt memcachec nut \ aggregation curl_json log_logstash memcached \ threshold write_log write_riemann +# threshold write_log .for _plugin in ${ENABLED_PLUGINS} CONFIGURE_ARGS += --enable-${_plugin} .endfor -CONFIGURE_ENV += CPPFLAGS='-I${LOCALBASE}/include' \ +CONFIGURE_ENV += PYTHON_CONFIG='${LOCALBASE}/bin/python2.7-config' \ + CPPFLAGS='-I${LOCALBASE}/include' \ LDFLAGS='-L${LOCALBASE}/lib -L${X11BASE}/lib -pthread' .include Index: distinfo === RCS file: /cvs/ports/sysutils/collectd/distinfo,v retrieving revision 1.7 diff -u -p -r1.7 distinfo --- distinfo13 Jun 2016 09:12:40 - 1.7 +++ distinfo14 Nov 2016 17:00:04 - @@ -1,2 +1,2 @@ -SHA256 (collectd-5.5.1.tar.gz) = TbpR1iQ/93hY//H/vv5vZShoH/IZBR8SKqJyfiYnEHk= -SIZE (collectd-5.5.1.tar.gz) = 2254181 +SHA256 (collectd-5.6.1.tar.bz2) = ww/2RPkUB7TcLZl4e5nMRewA5Ti9HMJpQp08XopK7iw= +SIZE (collectd-5.6.1.tar.bz2) = 1903962 Index: patches/patch-Makefile_in === RCS file: /cvs/ports/sysutils/collectd/patches/patch-Makefile_in,v retrieving revision 1.6 diff -u -p -r1.6 patch-Makefile_in --- patches/patch-Makefile_in 13 Jun 2016 09:12:40 - 1.6 +++ patches/patch-Makefile_in 14 Nov 2016 17:00:04 - @@ -1,8 +1,7 @@ -$OpenBSD: patch-Makefile_in,v 1.6 2016/06/13 09:12:40 landry Exp $ -dont create var/{run,lib,log} Makefile.in.orig Fri Jan 22 10:55:46 2016 -+++ Makefile.inMon Jun 6 09:18:40 2016 -@@ -947,9 +947,6 @@ uninstall-am: +$OpenBSD$ +--- Makefile.in.orig Wed Nov 9 19:58:43 2016 Makefile.inWed Nov 9 19:59:27 2016 +@@ -988,9 +988,6 @@ uninstall-am: install-exec-hook: Index: patches/patch-configure
Re: [UPDATE] sysutils/collectd + [NEW] sysutils/riemann-c-client
Sorry, forgot to cvs delete before diff. The correct diff for sysutils/collectd attached. -- With best regards, Pavel Korovin Index: Makefile === RCS file: /cvs/ports/sysutils/collectd/Makefile,v retrieving revision 1.40 diff -u -p -r1.40 Makefile --- Makefile7 Nov 2016 10:51:36 - 1.40 +++ Makefile14 Nov 2016 17:31:23 - @@ -9,10 +9,9 @@ COMMENT-virt = collectd libvirt plugin COMMENT-python = collectd python plugin COMMENT-memcachec =collectd memcachec plugin COMMENT-nut = collectd nut plugin +COMMENT-riemann = collectd riemann plugin -V =5.5.1 -REVISION-main =0 -REVISION-virt =1 +V =5.6.1 DISTNAME = collectd-$V PKGNAME-main = collectd-$V PKGNAME-mysql =collectd-mysql-$V @@ -23,6 +22,7 @@ PKGNAME-virt =collectd-virt-$V PKGNAME-python = collectd-python-$V PKGNAME-memcachec =collectd-memcachec-$V PKGNAME-nut = collectd-nut-$V +PKGNAME-riemann = collectd-riemann-$V CATEGORIES = sysutils HOMEPAGE = http://www.collectd.org/ @@ -32,11 +32,13 @@ SHARED_LIBS += collectdclient 1.0 PERMIT_PACKAGE_CDROM = Yes MASTER_SITES = ${HOMEPAGE}/files/ +EXTRACT_SUFX = .tar.bz2 MODULES = devel/gettext lang/python MODPY_RUNDEP = No -MULTI_PACKAGES = -main -mysql -pgsql -rrdtool -snmp -virt -python -memcachec -nut +MULTI_PACKAGES = -main -mysql -pgsql -rrdtool -snmp -virt -python -memcachec -nut -riemann + WANTLIB-mysql =crypto m ssl z mysqlclient_r pthread LIB_DEPENDS-mysql =databases/mariadb @@ -78,6 +80,11 @@ LIB_DEPENDS-nut =nut->=2.7.3p0:sysutils RUN_DEPENDS-nut = collectd-$V:${BASE_PKGPATH},-main WANTLIB-nut = crypto pthread ssl upsclient +LIB_DEPENDS-riemann = sysutils/riemann-c-client +WANTLIB-riemann = c gmp gnutls ffi hogweed intl iconv idn json-c m \ + nettle protobuf p11-kit pthread riemann-client stdc++ tasn1 z +RUN_DEPENDS-riemann = collectd-$V:${BASE_PKGPATH},-main + LIB_DEPENDS += net/curl \ net/liboping \ textproc/libxml \ @@ -99,7 +106,7 @@ CONFIGURE_ARGS +=--with-ltdl-include=${L --with-ltdl-lib=${LOCALBASE}/lib \ --with-librrd=${LOCALBASE} \ --with-libstatgrab=${LOCALBASE} \ - --with-libnetsnmp=${LOCALBASE}/bin/net-snmp-config \ + --with-libnetsnmp=${LOCALBASE} \ --with-python=${MODPY_BIN} \ --enable-all-plugins=no @@ -117,12 +124,14 @@ ENABLED_PLUGINS = apache apcups ascent b users uuid write_http write_graphite pf python virt memcachec nut \ aggregation curl_json log_logstash memcached \ threshold write_log write_riemann +# threshold write_log .for _plugin in ${ENABLED_PLUGINS} CONFIGURE_ARGS += --enable-${_plugin} .endfor -CONFIGURE_ENV += CPPFLAGS='-I${LOCALBASE}/include' \ +CONFIGURE_ENV += PYTHON_CONFIG='${LOCALBASE}/bin/python2.7-config' \ + CPPFLAGS='-I${LOCALBASE}/include' \ LDFLAGS='-L${LOCALBASE}/lib -L${X11BASE}/lib -pthread' .include Index: distinfo === RCS file: /cvs/ports/sysutils/collectd/distinfo,v retrieving revision 1.7 diff -u -p -r1.7 distinfo --- distinfo13 Jun 2016 09:12:40 - 1.7 +++ distinfo14 Nov 2016 17:31:23 - @@ -1,2 +1,2 @@ -SHA256 (collectd-5.5.1.tar.gz) = TbpR1iQ/93hY//H/vv5vZShoH/IZBR8SKqJyfiYnEHk= -SIZE (collectd-5.5.1.tar.gz) = 2254181 +SHA256 (collectd-5.6.1.tar.bz2) = ww/2RPkUB7TcLZl4e5nMRewA5Ti9HMJpQp08XopK7iw= +SIZE (collectd-5.6.1.tar.bz2) = 1903962 Index: patches/patch-Makefile_in === RCS file: /cvs/ports/sysutils/collectd/patches/patch-Makefile_in,v retrieving revision 1.6 diff -u -p -r1.6 patch-Makefile_in --- patches/patch-Makefile_in 13 Jun 2016 09:12:40 - 1.6 +++ patches/patch-Makefile_in 14 Nov 2016 17:31:23 - @@ -1,8 +1,7 @@ -$OpenBSD: patch-Makefile_in,v 1.6 2016/06/13 09:12:40 landry Exp $ -dont create var/{run,lib,log} Makefile.in.orig Fri Jan 22 10:55:46 2016 -+++ Makefile.inMon Jun 6 09:18:40 2016 -@@ -947,9 +947,6 @@ uninstall-am: +$OpenBSD$ +--- Makefile.in.orig Wed Nov 9 19:58:43 2016 Makefile.inWed Nov 9 19:59:27 2016 +@@ -988,9 +988,6 @@ uninstall-am: install-exec-hook: Index: patches/patch-configure === RCS file: patches/patch-configure diff -N patches/patch-configure --- patches/patch-configure 13 Jun 2016
NEW: sysutils/riemann
Hi, Attached is the port for Riemann, a tool for monitoring distributed systems. More info: http://riemann.io/ -- With best regards, Pavel Korovin riemann-0.2.9.tar.gz Description: application/tar-gz