On Tue, 9 Jun 2015, Rainer Gerhards wrote:
Hi all,
chances are extremely well to get to better packaging projects. We had
some discussions internally in Adiscon, and I was able to secure the
help of Florian Riedl for getting this in the best possible shape.
Our goal is to get
- better packages
- more timely support for new distro releases
- support for a broader set of distros (e.g. Fedora, often requested)
- more ability for the community to steer this previous all-Adiscon project
The 0mq discussion that started this thread is a good example of what
this means.
With the help of more community involvment we can reach the goals. And
in order to make it easier to contribute, we need to streamline the
process of how we build, release, test, and announce packages.
Thankfully, Brian has offered to become an active team member. It
would be great if others would also join in.
I currently think that the right path to success is to start with
small but sufficiently large project part. So I would propose that we
focus on Ubuntu initially, get that part organized, learn a couple of
things and apply the gained experience later to a "final" project that
covers other distros as well (as mentioned by darix, the use of OBS
sounds very appealing to me).
In order to get going, I would like to see some ideas float on:
- how should we communicate?
(rsyslog mailing list, dedicated mailing list, github issue
trackers, IRC, ...)
I'd say the rsyslog mailing list, failing that a dedicated mailing list. But I
think that the issues we will be working through are useful to people who need
to roll their own version (to test something from git, or to enable specific
features).
- where do we track issues?
(I have a strong preferrence for the github issue trackers)
- what about doc?
- where should we place the build platform
(cloud I would guess, could we use Digital Ocean sponsorship for this)?
I don't know the details of using it, but the Suse Open Build Platform is
already setup to support a whole bunch of target distros. How close does it come
to covering everything we need?
Can it be used for all the different uses we want from this (distro release
builds, nightly builds, other)
If we have to roll our own infrastructure, some sort of cloud system is right.
Google donates time on their cloud system to opensource projects, I don't know
if it would be enough or not. Sponsorship from whoever is good :-)
- when do we start ;)
Clarification of the problem statement and where we are starting from :-)
right now there is the rsyslog-pkg-* repos on github that have the scripts that
adiscon uses internally. As I found when I went to use them, there are a few
oddities and too much hard-coded for adiscon internal use. But there is also a
lot of useful stuff there as well.
As we look at the build options, let's see how much of the existing stuff we can
re-use.
Also, let's try to make this be something that people can use when building
from git.
David Lang
- ... whatever else I haven't yet thought about.
Please take a moment to voice your preferrences!
Thanks,
Rainer
2015-06-03 21:08 GMT+02:00 David Lang <[email protected]>:
take a look at
https://github.com/rsyslog/rsyslog-pkg-ubuntu
to build locally without using the PPA infrastructure I apply the attached
patch (remove the sections for disabling usertools, that's a debugging thing
I have in place at the moment)
do pbuilder --create to create the compile environment, then I use the
following script to pull the latest updates and compile test packages
find . -name .git |sed s/.git// |while read file
do
echo "$file"
cd $file
/usr/bin/git fetch
/usr/bin/git pull
/usr/bin/git fetch --tags
# /usr/bin/git gc -q --aggressive
autoreconf -fi
./configure -q
rm *master*
make dist --quiet
cd -
done
echo "finished making source packages"
cd rsyslog-pkg-ubuntu
rm */LAST_VERSION.*
for i in libestr liblogging liblognorm librelp rsyslog
do
cd $i
rm ${i}_*
cp ../../$i/*master* .
../scripts/auto_daily_project.sh trusty v8-devel master
(
echo '1'
echo '1'
echo '1'
echo '1'
) |../scripts/build.sh
echo "finished making $i"
cd -
done
This should help get you started :-)
David Lang
On Wed, 3 Jun 2015, Brian Knox wrote:
Date: Wed, 3 Jun 2015 11:48:20 -0400
From: Brian Knox <[email protected]>
Reply-To: rsyslog-users <[email protected]>
To: rsyslog-users <[email protected]>
Subject: Re: [rsyslog] rsyslog adiscon packages
Ubuntu LTS is currently what I'm using so that's advantageous. In
addition, I've built a custom rsyslog package for Ubuntu that includes
omczmq / imczmq along with debs for the dependencies. However, my rsyslog
package is monolithic and I'm using brew2deb, which is kind of a strange
wrapper around fpm and homebrew that probably isn't the best way to do
things.
Ubuntu and Debian pacakge libzmq (but not czmq). Their packages are
behind
current, but maybe their packages would be a good and hopefully easy place
to start, depending on how packages are being built currently for the
ubuntu repo.
If there's build scripts for the current repo now, I'd be happy to work
through them and do the work.
Brian
On Wed, Jun 3, 2015 at 11:38 AM, Rainer Gerhards
<[email protected]>
wrote:
Would it be a good idea to start with Ubuntu?
Sent from phone, thus brief.
Am 03.06.2015 16:23 schrieb "Brian Knox" <[email protected]>:
I'm on board!
Cheers,
Brian
On Wed, Jun 3, 2015 at 10:07 AM, Rainer Gerhards <
[email protected]
wrote:
Sent from phone, thus brief.
Am 03.06.2015 15:58 schrieb "Brian Knox" <[email protected]>:
I'm a member of the zeromq team :)
I know ;)
What would I need to do?
Join the rsyslog release team and keep an eye especially on zmq. As I
wrote
is just something we need to newly setup.
Brian
On Wed, Jun 3, 2015 at 9:56 AM, Rainer Gerhards <
[email protected]>
wrote:
2015-06-03 14:50 GMT+02:00 Brian Knox <[email protected]>:
I've been working on the new zeromq plugins ( contrib/omczmq and
contrib/imczmq) for a bit, and have been using them in production
myself
for quite awhile.
Yesterday, the zeromq organization released zeromq 4.1 (
http://zeromq.org/intro:get-the-software ) and czmq 3.0 (
http://czmq.zeromq.org/page:get-the-software ) stable releases,
which
are
the versions of zeromq and czmq ( a nice C api on top of libzmq )
that
om/imczmq depend on.
I was wondering if it would be possible to get these added to the
packages
now the same way librdkafka / omkafka is set up.
The dependencies are:
* libsodium ( included in most distros now afaik, but latest
stable
source
is also at
https://download.libsodium.org/libsodium/releases/libsodium-1.0.3.tar.gz
)
* zeromq 4.1 ( http://download.zeromq.org/zeromq-4.1.1.tar.gz )
* czmq 3.0 ( http://download.zeromq.org/czmq-3.0.1.tar.gz )
The main "problem" is that we do not want to be responsible to
maintain 0mq in regard to checking for patches etc... However, if a
member of the 0mq team is also a member of our release team and
looks
after that, this problem can be solved ;)
Maybe we could use a DigitalOcean droplet to run the package
creation
scripts in the future, this would also solve a bit on the
collaboration front. What do you think?
If that's a way to go, it's probably not done immediately, as "a
little bit of setup and redesign work" is involved, but we could
work
towards that goal...
Rainer
The only option flag needed is --enable-libsodium on the zeromq
4.1
build.
I'd be happy to work with whoever works on the packages. Getting
this
easy
to install would be helpful, and the more people attempting to
use
the
plugins the more feedback I can get.
Cheers,
Brian
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a
myriad
of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if
you
DON'T LIKE THAT.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a
myriad
of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if
you
DON'T LIKE THAT.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a
myriad
of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you
DON'T LIKE THAT.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a
myriad
of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you
DON'T LIKE THAT.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad
of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you
DON'T LIKE THAT.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad
of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you
DON'T LIKE THAT.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad
of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T
LIKE THAT.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T
LIKE THAT.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE
THAT.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE
THAT.