it's actually the implicit protobuf decoder that's shutting down (probably because it's not a protobuf input). you probably want to specify a decoder as well as a splitter; the payloadregexdecoder is slow, but easy to test against.
``` [hekad] maxprocs = 2 [TcpInput] address = ":5514" splitter = "newline_splitter" decoder = "gross_decoder" [newline_splitter] type = "TokenSplitter" delimiter = '\n' [gross_decoder] type = "PayloadRegexDecoder" match_regex = "^(?P<Message>.+)" [PayloadEncoder] append_newlines = true [LogOutput] message_matcher = "TRUE" encoder = "PayloadEncoder" ``` ``` [nathwill@wyrd ~]$ hekad -config=test.toml 2015/08/19 13:53:22 Pre-loading: [PayloadEncoder] 2015/08/19 13:53:22 Pre-loading: [LogOutput] 2015/08/19 13:53:22 Pre-loading: [TcpInput] 2015/08/19 13:53:22 Pre-loading: [newline_splitter] 2015/08/19 13:53:22 Pre-loading: [gross_decoder] 2015/08/19 13:53:22 Pre-loading: [TokenSplitter] 2015/08/19 13:53:22 Loading: [TokenSplitter] 2015/08/19 13:53:22 Pre-loading: [HekaFramingSplitter] 2015/08/19 13:53:22 Loading: [HekaFramingSplitter] 2015/08/19 13:53:22 Pre-loading: [NullSplitter] 2015/08/19 13:53:22 Loading: [NullSplitter] 2015/08/19 13:53:22 Pre-loading: [ProtobufDecoder] 2015/08/19 13:53:22 Loading: [ProtobufDecoder] 2015/08/19 13:53:22 Pre-loading: [ProtobufEncoder] 2015/08/19 13:53:22 Loading: [ProtobufEncoder] 2015/08/19 13:53:22 Loading: [gross_decoder] 2015/08/19 13:53:22 Loading: [PayloadEncoder] 2015/08/19 13:53:22 Loading: [newline_splitter] 2015/08/19 13:53:22 Loading: [TcpInput] 2015/08/19 13:53:22 Loading: [LogOutput] 2015/08/19 13:53:22 Starting hekad... 2015/08/19 13:53:22 Output started: LogOutput 2015/08/19 13:53:22 MessageRouter started. 2015/08/19 13:53:22 Input started: TcpInput 2015/08/19 13:53:29 huhu\n ``` On Wed, Aug 19, 2015 at 1:44 PM, Christian Kniep <[email protected]> wrote: > Hey y’all, > > after opening an issue on github I am still not sure how to create the TCP > input to allow me sending arbitrary strings. > https://github.com/mozilla-services/heka/issues/1683 > > I am creating a docker image out of it: > https://github.com/qnib/docker-heka > > My heka.toml looks as follows: > ############## > [hekad] > maxprocs = 2 > > [TcpInput] > address = ":5514" > splitter = "newline_splitter" > > [newline_splitter] > type = "RegexSplitter" > delimiter = '\n' > delimiter_eol = true > > [split_on_space] > type = "TokenSplitter" > delimiter = " " > > [PayloadEncoder] > append_newlines = true > > [LogOutput] > message_matcher = "TRUE" > encoder = “PayloadEncoder" > ############## > > If I send a string the TCPInput stops: > ############## > [root@heka tmp]# /opt/heka/bin/hekad -config=/etc/heka/hekad.toml > 2015/08/19 22:38:14 Pre-loading: [LogOutput] > 2015/08/19 22:38:14 Pre-loading: [TcpInput] > 2015/08/19 22:38:14 Pre-loading: [newline_splitter] > 2015/08/19 22:38:14 Pre-loading: [split_on_space] > 2015/08/19 22:38:14 Pre-loading: [PayloadEncoder] > 2015/08/19 22:38:14 Pre-loading: [HekaFramingSplitter] > 2015/08/19 22:38:14 Loading: [HekaFramingSplitter] > 2015/08/19 22:38:14 Pre-loading: [NullSplitter] > 2015/08/19 22:38:14 Loading: [NullSplitter] > 2015/08/19 22:38:14 Pre-loading: [ProtobufDecoder] > 2015/08/19 22:38:14 Loading: [ProtobufDecoder] > 2015/08/19 22:38:14 Pre-loading: [ProtobufEncoder] > 2015/08/19 22:38:14 Loading: [ProtobufEncoder] > 2015/08/19 22:38:14 Pre-loading: [TokenSplitter] > 2015/08/19 22:38:14 Loading: [TokenSplitter] > 2015/08/19 22:38:14 Loading: [PayloadEncoder] > 2015/08/19 22:38:14 Loading: [newline_splitter] > 2015/08/19 22:38:14 Loading: [split_on_space] > 2015/08/19 22:38:14 Loading: [TcpInput] > 2015/08/19 22:38:14 Loading: [LogOutput] > 2015/08/19 22:38:14 Starting hekad... > 2015/08/19 22:38:14 Output started: LogOutput > 2015/08/19 22:38:14 MessageRouter started. > 2015/08/19 22:38:14 Input started: TcpInput > 2015/08/19 22:38:18 Decoder 'TcpInput-ProtobufDecoder-::1': stopped > 2015/08/19 22:38:18 > ############## > While sending something like this: > # echo "huhu\n"|nc -w1 localhost 5514 > > Cheers > Christian > > _______________________________________________ > Heka mailing list > [email protected] > https://mail.mozilla.org/listinfo/heka > >
_______________________________________________ Heka mailing list [email protected] https://mail.mozilla.org/listinfo/heka
