Hello,

You did not say what the source charset is. Even without that there
shouldn't be invalid utf-8 characters in the output after convert_fields()
is called.
Can you confirm that this is not a logstash issue? The following would
help troubleshoot this:
* config file: im_file => convert_fields => om_file
* input file used to feed im_file
* output produced by om_file

Regards,
Botond


On Wed, 25 Dec 2013 22:35:12 -0500
Aaron Anderson <lvlaa...@live.com> wrote:

> Using nxlog-ce on Windows to send IIS logs as JSON to Logstash (and stored in 
> Elasticsearch)
> 
> Logstash is yelling (crashing) about some odd characters that are in my log.
> 
> ==== Error Section =====
> Failed to flush outgoing items {:outgoing_count=>80, 
> :exception=>#<Encoding::InvalidByteSequenceError: ""\xDF"" on ASCII-8BIT>
> ========================
> 
> 
> 
> I'm using xm_charconv in my output block to do this "convert_fields("AUTO", 
> "utf-8");" and that has helped with some issues, but I feel like nxlog isn't 
> converting "\xDF" to UTF-8. The nxlog documentation says to "See iconv -l for 
> a list of encoding names." but I don't see ASCII-8BIT on the list.
> 
> Any ideas?                                      
> ------------------------------------------------------------------------------
> Rapidly troubleshoot problems before they affect your business. Most IT 
> organizations don't have a clear picture of how application performance 
> affects their revenue. With AppDynamics, you get 100% visibility into your 
> Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
> http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk
> _______________________________________________
> nxlog-ce-users mailing list
> nxlog-ce-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/nxlog-ce-users

------------------------------------------------------------------------------
Rapidly troubleshoot problems before they affect your business. Most IT 
organizations don't have a clear picture of how application performance 
affects their revenue. With AppDynamics, you get 100% visibility into your 
Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk
_______________________________________________
nxlog-ce-users mailing list
nxlog-ce-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nxlog-ce-users

Reply via email to