Hello, You did not say what the source charset is. Even without that there shouldn't be invalid utf-8 characters in the output after convert_fields() is called. Can you confirm that this is not a logstash issue? The following would help troubleshoot this: * config file: im_file => convert_fields => om_file * input file used to feed im_file * output produced by om_file
Regards, Botond On Wed, 25 Dec 2013 22:35:12 -0500 Aaron Anderson <lvlaa...@live.com> wrote: > Using nxlog-ce on Windows to send IIS logs as JSON to Logstash (and stored in > Elasticsearch) > > Logstash is yelling (crashing) about some odd characters that are in my log. > > ==== Error Section ===== > Failed to flush outgoing items {:outgoing_count=>80, > :exception=>#<Encoding::InvalidByteSequenceError: ""\xDF"" on ASCII-8BIT> > ======================== > > > > I'm using xm_charconv in my output block to do this "convert_fields("AUTO", > "utf-8");" and that has helped with some issues, but I feel like nxlog isn't > converting "\xDF" to UTF-8. The nxlog documentation says to "See iconv -l for > a list of encoding names." but I don't see ASCII-8BIT on the list. > > Any ideas? > ------------------------------------------------------------------------------ > Rapidly troubleshoot problems before they affect your business. Most IT > organizations don't have a clear picture of how application performance > affects their revenue. With AppDynamics, you get 100% visibility into your > Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! > http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk > _______________________________________________ > nxlog-ce-users mailing list > nxlog-ce-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/nxlog-ce-users ------------------------------------------------------------------------------ Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into your Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk _______________________________________________ nxlog-ce-users mailing list nxlog-ce-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nxlog-ce-users