Just curious if you have any feedback. I tried this plugin and it is not working. We are using hadoop 2.7.1 2016-01-27T06:53:05.616-06:00 WARN [WebHDFSOutput] Exception while writing to HDFS java.io.IOException: Server returned HTTP response code: 400 for URL: http://dfwlnpmqm-01:50070/webhdfs/v1//syslog/dfwlnqcpqdb-02.supermedia.com/messages/20160127?op=APPEND&user.name=graylog at sun.reflect.GeneratedConstructorAccessor75.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:422) at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1890) at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1885) at java.security.AccessController.doPrivileged(Native Method) at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1884) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1457) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at org.apache.hadoop.fs.http.client.WebHDFSConnection.result(WebHDFSConnection.java:128) at org.apache.hadoop.fs.http.client.WebHDFSConnection.append(WebHDFSConnection.java:550) at org.graylog.outputs.hdfs.WebHDFSOutput.writeToHdfs(WebHDFSOutput.java:148) at org.graylog.outputs.hdfs.WebHDFSOutput.writeToHdfs(WebHDFSOutput.java:139) at org.graylog.outputs.hdfs.WebHDFSOutput.access$000(WebHDFSOutput.java:27) at org.graylog.outputs.hdfs.WebHDFSOutput$1.run(WebHDFSOutput.java:92) at java.util.TimerThread.mainLoop(Timer.java:555) at java.util.TimerThread.run(Timer.java:505) Caused by: java.io.IOException: Server returned HTTP response code: 400 for URL: http://dfwlnpmqm-01:50070/webhdfs/v1//syslog/dfwlnqcpqdb-02.supermedia.com/messages/20160127?op=APPEND&user.name=graylog at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1840) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441) at sun.net.www.protocol.http.HttpURLConnection.getHeaderField(HttpURLConnection.java:2943) at org.apache.hadoop.fs.http.client.WebHDFSConnection.append(WebHDFSConnection.java:549) ... 6 more
On Thursday, July 30, 2015 at 10:40:15 AM UTC-5, Sivasamy Kaliappan wrote: > > All, > > I have developed a Hadoop output plugin for graylog to forward the stream > output to Hadoop HDFS. > The plugin uses WebHDFS protocol to talk to Hadoop cluster. > > It support custom message formats and pseudo authentication. > > Give it a try and let me know your comments. > > Plugin URL : https://github.com/sivasamyk/graylog-plugin-output-webhdfs > > Regards, > Siva. > -- You received this message because you are subscribed to the Google Groups "Graylog Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/graylog2/b3eb127f-f40f-4dfc-a13f-688f1564f791%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
