Re: [SLUG] Open source log analyser tools (or: Alternatives to Splunk)

[Simon Rumble]

On 9 May 2012 15:20, Mark Walkom  wrote:

> We are looking at Splunk for syslog analysing to close a hole in our
> application visibility, but it's expensive.
>
> I've looked at alternatives like logstash and graylog2, but I wanted to see
> if anyone had some experiences they would be willing to share on either
> splunk or other.
> This was raised a couple of years ago but I figure the scene has changed a
> fair bit since then!
>

Splunk isn't expensive and it's bloody amazing. US$6,000 for 500 megs a day
perpetual license. How much log data are you generating that this seems
expensive? I doubt you'll find anything that comes close.

-- 
Simon Rumble 
-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] Job Management Apps

[Michael Chesterton]

On Wed, May 9, 2012 at 4:06 PM, Nigel Allen  wrote:

>
> Whatever we can come up with would ideally have an android client or at
> least sync with Google calendar for appointments and / or follow ups. I
> was looking at SugarCRM but I think that that is a little sledge hammer
> / nut for this.
>
> Any suggestions? Any Ideas? Any thought?
>

You mentioned google calendar, so maybe google spreadsheet and google forms?
Not an FOSS solution though, which means if google decides to change
something,
you're kind of locked into doing whatever google wants you to do,
although I imagine you'd always be able to download your data.
-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

[SLUG] Job Management Apps

[Nigel Allen]

Hi All

I've been looking for an application for a while that can be used for a
handyman service - but a handyman service with a difference.

Basically the handyman receives work orders from a Strata Management or
Real Estate company to contact John Smith of so and such address and
telephone number to arrange for some repairs to be carried out.

Bear in mind that there are usually multiple jobs being done simultaneously.

  * First task is to contact the person in question and arrange an
appointment. This often takes several calls.
  * Sometimes the repairs are specified in the work order but often they
are not and a first appointment is usually necessary just to
establish the extent of the work.
  * Sometimes there is a quotation required which goes back to the
managing company - other times it's just "do and charge".
  * A second appointment is often necessary to perform the work although
of the planet align the job may be done and completed during the
first appointment.
  * Often the job involves time and materials, sometimes it's just labour.
  * Finally the job has to be invoiced back to the management company.
Currently invoicing is done in MYOB and I'm happy to leave that as
it is.

Whatever we can come up with would ideally have an android client or at
least sync with Google calendar for appointments and / or follow ups. I
was looking at SugarCRM but I think that that is a little sledge hammer
/ nut for this.

Any suggestions? Any Ideas? Any thought?

TIA

Nigel.

-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

[SLUG] Open source log analyser tools (or: Alternatives to Splunk)

[Mark Walkom]

We are looking at Splunk for syslog analysing to close a hole in our
application visibility, but it's expensive.

I've looked at alternatives like logstash and graylog2, but I wanted to see
if anyone had some experiences they would be willing to share on either
splunk or other.
This was raised a couple of years ago but I figure the scene has changed a
fair bit since then!

Cheers,
Mark
-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] $11.7m for OLPC Australia in the federal govt budget

[Sridhar Dhanapalan]

On 9 May 2012 11:50, Robert Collins  wrote:
> On Wed, May 9, 2012 at 1:03 PM, Sridhar Dhanapalan
>  wrote:
>> "The Australian Government is providing over $11 million to support
>> the One Laptop Per Child (OLPC) Program which will deliver over 50,000
>
> Thats pretty awesome. Are OLPC still doing the 'buy one donate one' program?

OLPC Australia (which is an independent entity based in Sydney) does
not run such a programme, for many logistical, educational and
financial reasons. The OLPC Association (which is based in Miami) has
run Give One Get One (G1G1) a few times for limited periods in the
USA.

A core belief of OLPC Australia is that technology cannot be
successfully deployed without teacher training and buy-in from the
school, children and community. Our programme to address that is
called One Education: http://www.one-education.org/

You can fill in the contact form on that site if you would like to
know more, would like to help, or are a school that would like to
participate in the programme.

I am Engineering Manager and I also manage technical support. I'd be
happy to discuss further if you'd like to assist in those areas.

Sridhar


-- 
"Our mission is to enhance learning opportunities for over 500,000
primary school aged children by providing each one with a connected XO
laptop as part of a sustainable training and support program, by
2015."
 http://www.laptop.org.au/
 http://dev.laptop.org.au/participate
--
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] $11.7m for OLPC Australia in the federal govt budget

[Robert Collins]

On Wed, May 9, 2012 at 1:03 PM, Sridhar Dhanapalan
 wrote:
> "The Australian Government is providing over $11 million to support
> the One Laptop Per Child (OLPC) Program which will deliver over 50,000

Thats pretty awesome. Are OLPC still doing the 'buy one donate one' program?

-Rob
-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

[SLUG] $11.7m for OLPC Australia in the federal govt budget

[Sridhar Dhanapalan]

"The Australian Government is providing over $11 million to support
the One Laptop Per Child (OLPC) Program which will deliver over 50,000
custom built laptops to primary students in regional and remote
Australia as part of a 12 month pilot program. The OLPC Australia
Organisation (OLPC Australia) aims to support the learning
opportunities of indigenous children, particularly those in remote
Australia, by providing primary school aged children with a connected
XO laptop as part of a sustainable training and support program.
Participating schools will also receive information and communications
technology (ICT) coordinator professional development, local repair
kits, and access to helpdesk and online support."

http://blog.laptop.org/2012/05/08/australian-brilliance-government-12m-pilot/


-- 
"Our mission is to enhance learning opportunities for over 500,000
primary school aged children by providing each one with a connected XO
laptop as part of a sustainable training and support program, by
2015."
 http://www.laptop.org.au/
 http://dev.laptop.org.au/participate
--
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] High System CPU usage and finding culprit

[Jason Ball]

my solution appears to have fixed the problems I was seeing for a little
over a week now. As such - reported to Centos for fixing...

http://bugs.centos.org/view.php?id=5716

Cheers
J.


On Wed, May 9, 2012 at 10:28 AM, Jason Ball  wrote:

> I've seen a similar problem that took several weeks to identify.
>
> There is an issue with transparent hugepage support (aka memory defrag)
> where it causes processes on a server to stall and a number of other weird
> symptoms, I actually suspected dodgy drivers for one of my raid controllers
> before I found the cause.
>
> The solution (in my case) was to disable this facility:
>
>
> echo no > /sys/kernel/mm/redhat_transparent_hugepage/khugepaged/defrag
> echo never >/sys/kernel/mm/redhat_transparent_hugepage/defrag
>
> It's worth noting that this setting appears to be disabled by default on
> RHEL6 installations, but enabled on Centos 6.
>
>
> Cheers
> Jason.
>
>
>
> On Wed, May 9, 2012 at 10:15 AM, Michael Fox  wrote:
>
>> In which case, enable sysstat on centos if it's not already. will help
>> moving forward..
>>
>> On Wed, May 9, 2012 at 10:11 AM, Grant Street  wrote:
>>
>> > 16 core, 12-24G memory running centos 6.1
>> >
>> >
>> > On 09/05/12 10:08, David Lyon wrote:
>> >
>> >> Are they dual core ?
>> >>
>> >> Do they have a sheetload of memory ?
>> >>
>> >> I found ubuntu got slower and slower till I got in
>> >> newer hardware.
>> >>
>> >
>> > --
>> > SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
>> > Subscription info and FAQs: http://slug.org.au/faq/**mailinglists.html<
>> http://slug.org.au/faq/mailinglists.html>
>> >
>> --
>> SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
>> Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
>>
>
>
>
> --
> --
> Teach your kids Science, or somebody else will :/
>
> ja...@ball.net
> vk2...@google.com 
> callsign: vk2vjb
>
>
>


-- 
--
Teach your kids Science, or somebody else will :/

ja...@ball.net
vk2...@google.com 
callsign: vk2vjb
-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] High System CPU usage and finding culprit

[Jason Ball]

I've seen a similar problem that took several weeks to identify.

There is an issue with transparent hugepage support (aka memory defrag)
where it causes processes on a server to stall and a number of other weird
symptoms, I actually suspected dodgy drivers for one of my raid controllers
before I found the cause.

The solution (in my case) was to disable this facility:

echo no > /sys/kernel/mm/redhat_transparent_hugepage/khugepaged/defrag
echo never >/sys/kernel/mm/redhat_transparent_hugepage/defrag

It's worth noting that this setting appears to be disabled by default on
RHEL6 installations, but enabled on Centos 6.


Cheers
Jason.


On Wed, May 9, 2012 at 10:15 AM, Michael Fox  wrote:

> In which case, enable sysstat on centos if it's not already. will help
> moving forward..
>
> On Wed, May 9, 2012 at 10:11 AM, Grant Street  wrote:
>
> > 16 core, 12-24G memory running centos 6.1
> >
> >
> > On 09/05/12 10:08, David Lyon wrote:
> >
> >> Are they dual core ?
> >>
> >> Do they have a sheetload of memory ?
> >>
> >> I found ubuntu got slower and slower till I got in
> >> newer hardware.
> >>
> >
> > --
> > SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
> > Subscription info and FAQs: http://slug.org.au/faq/**mailinglists.html<
> http://slug.org.au/faq/mailinglists.html>
> >
> --
> SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
> Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
>



-- 
--
Teach your kids Science, or somebody else will :/

ja...@ball.net
vk2...@google.com 
callsign: vk2vjb
-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] High System CPU usage and finding culprit

[John Ferlito]

On Wed, May 09, 2012 at 10:11:43AM +1000, Grant Street wrote:
> 16 core, 12-24G memory running centos 6.1

I can highly recommend collectd for collecting system stats. It
collects them at 10 seconds and it knows about an amazing load of
stuff. Really easy to go back in time and work out what was going on
with the whole system.

I could probably be convinced to give a talk on this at SLUG,

Cheers,
John

-- 
John
Blog http://www.inodes.org
LCA2012  http://lcaunderthestars.org.au
-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] High System CPU usage and finding culprit

[Michael Fox]

In which case, enable sysstat on centos if it's not already. will help
moving forward..

On Wed, May 9, 2012 at 10:11 AM, Grant Street  wrote:

> 16 core, 12-24G memory running centos 6.1
>
>
> On 09/05/12 10:08, David Lyon wrote:
>
>> Are they dual core ?
>>
>> Do they have a sheetload of memory ?
>>
>> I found ubuntu got slower and slower till I got in
>> newer hardware.
>>
>
> --
> SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
> Subscription info and FAQs: 
> http://slug.org.au/faq/**mailinglists.html
>
-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] High System CPU usage and finding culprit

[Grant Street]

16 core, 12-24G memory running centos 6.1

On 09/05/12 10:08, David Lyon wrote:

Are they dual core ?

Do they have a sheetload of memory ?

I found ubuntu got slower and slower till I got in
newer hardware.


--
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] High System CPU usage and finding culprit

[Michael Fox]

Hello Grant,

Distribution? Release?

I'd go about reviewing the sysstat output (aka sar reports) during the
period of the issue to see io stats, any usful things to see if something
stands out. Will also allow you to review the swap usage  during those
times too.

If the package is not installed, get it installed for the next occurences.

Thanks

On Wed, May 9, 2012 at 9:49 AM, Grant Street  wrote:

> Hello
>
> I have some desktop linux machines that have periods of extremely high
> system time (30-90%) with no obvious cause. The users see it as a hang or a
> freeze to the point of 10sec for a key press to register. it comes and goes
> seemingly randomly but only lasts max about 1-2 min.
>
> What I'm after is any hints on how to track down whats causing this.
>
> Symptoms
> - load average is low (sub 1)
> - No process is consuming a lot of cpu (from top)
> - No swapping is occurring at the time
> - plenty of free memory
> - no/low IOwait%
> - IRQ% is 0
> - Still has Idle available
> - nothing in dmesg
>
> Any help or investigation tips would be appreciated
>
> Thanks
> --
> SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
> Subscription info and FAQs: 
> http://slug.org.au/faq/**mailinglists.html
>
-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] High System CPU usage and finding culprit

[David Lyon]

Are they dual core ?

Do they have a sheetload of memory ?

I found ubuntu got slower and slower till I got in
newer hardware.
-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

[SLUG] High System CPU usage and finding culprit

[Grant Street]

Hello

I have some desktop linux machines that have periods of extremely high 
system time (30-90%) with no obvious cause. The users see it as a hang 
or a freeze to the point of 10sec for a key press to register. it comes 
and goes seemingly randomly but only lasts max about 1-2 min.


What I'm after is any hints on how to track down whats causing this.

Symptoms
- load average is low (sub 1)
- No process is consuming a lot of cpu (from top)
- No swapping is occurring at the time
- plenty of free memory
- no/low IOwait%
- IRQ% is 0
- Still has Idle available
- nothing in dmesg

Any help or investigation tips would be appreciated

Thanks
--
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html