[graylog2] graylog collector sidecar and winloigbeat language issue

2017-02-20 Thread Daniel Kamiński
Hi I'm collecting logs from Windows Serwer 2012 R2 using graylog collector sidecar with winlogbeat, and I have issues with logs language. The system was installed as Polish (my language) but later we changed language to English, now everything is in English except messages sent by winlogbeat

[graylog2] Re: Graylog is increasing log's size

2016-09-13 Thread Daniel Kamiński
maybe you're indexing some unnecessary fields? try to disable less needed data, you can also strip them off with pipelines before they get processed further, also I heard that BTRFS with compression enabled works nice with ES, W dniu poniedziałek, 12 września 2016 16:56:36 UTC+2 użytkownik

[graylog2] Re: Graylog in Docker 2.1

2016-09-13 Thread Daniel Kamiński
; confirm that you use just the GRAYLOG_REST_TRANSPORT_URI variable? > > thanks > > On Sunday, September 11, 2016 at 6:09:02 AM UTC-3, Daniel Kamiński wrote: >> >> I also stumbled on this error, passing machine network ip rather than >> local 127.0.0.1 kind of worked >

[graylog2] Re: Graylog in Docker 2.1

2016-09-11 Thread Daniel Kamiński
I also stumbled on this error, passing machine network ip rather than local 127.0.0.1 kind of worked W dniu piątek, 2 września 2016 22:48:30 UTC+2 użytkownik Hernán Fernández napisał: > > Hello, > > I just saw that the rest api is running now on the web interface and the > variable

[graylog2] any scripts for deleting messages containing fields with dots?

2016-04-28 Thread Daniel Kamiński
Hello I was playing with snmp some time ago, it created multiple* fields with dots*. Now new ES doesn't support dots in fields names so I cannot upgrade to graylog 2.0. Messages with those fields contain* no valuable data*, so I'd like to *delete *them from few past indices (yes, I know, I have

[graylog2] Re: fielddata error with search

2016-04-22 Thread Daniel Kamiński
s, > Jochen > > On Thursday, 21 April 2016 13:14:46 UTC+2, Daniel Kamiński wrote: >> >> you can change 'message' mapping template in ES via it's rest api, and >> add `"doc_values": true` to some less needed fields, more info or doc >> values here: >

[graylog2] Re: fielddata error with search

2016-04-21 Thread Daniel Kamiński
you can change 'message' mapping template in ES via it's rest api, and add `"doc_values": true` to some less needed fields, more info or doc values here: https://www.elastic.co/guide/en/elasticsearch/reference/current/doc-values.html W dniu czwartek, 21 kwietnia 2016 00:48:57 UTC+2 użytkownik

[graylog2] Re: Renaming fields

2016-02-01 Thread Daniel Kamiński
You could work this around by rewriting messages with drools like here: http://docs.graylog.org/en/1.3/pages/drools.html, with modify($m) { removeField("unwantedField") } W dniu piątek, 29 stycznia 2016 10:38:03 UTC+1 użytkownik thePretender napisał: > > Hi, > > For normalization purposes, I

[graylog2] Re: hyper-v virtual appliance

2015-11-26 Thread Daniel Kamiński
It is possible to convert VDI/VMDK disk image to Microsoft's VHD with virtuabox' tools (`vboxmanage clonehd input output --format vhd`), no need to convert whole OVA as it's only a disk image with configuration file, i've done this before to test how graylog would work on hyper-v, i

[graylog2] drools rules metrics?

2015-09-17 Thread Daniel Kamiński
Hi, Is there any way I can extract info about how many rules have been affected by my drools rules? some kind of metrics of dropped/changed messages depending on rule. I know I can use log but it's too verbose, all i need is numbers. -- You received this message because you are subscribed to

[graylog2] Re: No data put into graylog with logstash

2015-06-24 Thread Daniel Kamiński
, %{[message_tmp][9]} ] remove_field = message_tmp } } output { gelf { host = '127.0.0.1' port = 12203 } } alternatively you can just send raw log to graylog and process it there W dniu środa, 24 czerwca 2015 10:23:01 UTC+2 użytkownik Daniel Kamiński napisał: The library used in logstash's gelf

[graylog2] Re: Variable Length Key=Value pairs

2015-06-24 Thread Daniel Kamiński
You need to create an extractor for each field, provided you know fields names, then you can extract a value with regex, like `fieldname=([^]*)` W dniu wtorek, 23 czerwca 2015 14:39:46 UTC+2 użytkownik David Gerdeman napisał: In the uri-query field of my IIS logs I have a website that

[graylog2] Re: No data put into graylog with logstash

2015-06-24 Thread Daniel Kamiński
The library used in logstash's gelf output is a bit broken, it doesn't flatten the structure, and graylog only understands flat json. In your case you split `message` field thus creating an array. You can delete message field but gelf output needs that field, so I suggest copying `message` to

[graylog2] Re: IP address mapping in elasticsearch index

2015-05-21 Thread Daniel Kamiński
/reference/current/indices-templates.html) but Graylog has not been tested with other data types in Elasticsearch, so you're on your own if any errors occur due to the index mapping changes. Cheers, Jochen On Wednesday, 20 May 2015 14:10:54 UTC+2, Daniel Kamiński wrote: Hi I'm trying

[graylog2] Re: Statistical analysis is only available for numeric field types.- Issue

2015-05-21 Thread Daniel Kamiński
it's worth to mention that it's not considered by graylog as a number if it's not blue in rubydebug codec. I had the same problems when configuring logstash for forwarding netflow data from cisco routers to graylog. I had to convert it somehow, ruby oneliner was the best solution. W dniu

[graylog2] Re: Extend Harddisk space on Graylog OVA installation

2015-05-20 Thread Daniel Kamiński
You can follow readme at: https://github.com/Graylog2/graylog2-images/tree/master/ova#extend-disk-space Basically you add new virtual disk, format it as ext4 or anothe linux compatible FS, mount somewhere temporarily and move on it files from `/var/opt/graylog/data`, and then mount under

[graylog2] Re: Storage size

2015-04-16 Thread Daniel Kamiński
it's vm image, so gparted wouldn't work You can of course just read OVA Readme https://github.com/Graylog2/graylog2-images/tree/master/ova :-) especially *Extend disk space* section, in short you have to generate new, larger hd image and make vm use it as second one, create partition on it,

Re: [graylog2] Re: graylog cycles deflector each restart after 1.0.1 update [OVA]

2015-03-24 Thread Daniel Kamiński
PM UTC+1, Daniel Kamiński wrote: Hi I'm using graylog ova, after I upgraded to 1.0.1 I noticed it creates a new index (cycles deflector) each restart. I had to tune some configuration and restart graylog couple of times today (it started to behave) and found out I created 10 indexes

[graylog2] graylog cycles deflector each restart after 1.0.1 update [OVA]

2015-03-23 Thread Daniel Kamiński
Hi I'm using graylog ova, after I upgraded to 1.0.1 I noticed it creates a new index (cycles deflector) each restart. I had to tune some configuration and restart graylog couple of times today (it started to behave) and found out I created 10 indexes today, each with few tousand messages. Is