So here is the really, i think, relevant log message I got:
log4j, [2014-09-29T08:35:22.061] WARN: org.elasticsearch.discovery:
[Asmodeus] waited for 30s and no initial state was set by the discovery
then a bit later:
log4j, [2014-09-29T08:35:22.061] WARN: org.elasticsearch.discovery:
[Asmodeus] waited for 30s and no initial state was set by the discovery
log4j, [2014-09-29T08:36:27.385] WARN:
org.elasticsearch.discovery.zen.ping.multicast: [Asmodeus] failed to
read requesting data from
/172.16.40.29:54328
java.io.IOException: Expected handle header, got [13]
at
org.elasticsearch.common.io.stream.HandlesStreamInput.readString(HandlesStreamInput.java:65)
at
org.elasticsearch.cluster.ClusterName.readFrom(ClusterName.java:64)
at
org.elasticsearch.cluster.ClusterName.readClusterName(ClusterName.java:58)
at
org.elasticsearch.discovery.zen.ping.multicast.MulticastZenPing$Receiver.run(MulticastZenPing.java:409
)
at java.lang.Thread.run(Thread.java:745)
log4j, [2014-09-29T08:36:28.895] WARN:
org.elasticsearch.discovery.zen.ping.multicast: [Asmodeus] failed to
read requesting data from
/172.16.40.29:54328
java.io.IOException: Expected handle header, got [13]
at
org.elasticsearch.common.io.stream.HandlesStreamInput.readString(HandlesStreamInput.java:65)
at
org.elasticsearch.cluster.ClusterName.readFrom(ClusterName.java:64)
at
org.elasticsearch.cluster.ClusterName.readClusterName(ClusterName.java:58)
at
org.elasticsearch.discovery.zen.ping.multicast.MulticastZenPing$Receiver.run(MulticastZenPing.java:409
)
at java.lang.Thread.run(Thread.java:745)
{:timestamp=>"2014-09-29T08:36:23.583000-0400", :message=>"Failed to flush
outgoing items", :outgoing_count=>51,
:exception=>org.elasticsearch.discovery.MasterNotDiscoveredException:
waited for [30s],
:backtrace=>["org.elasticsearch.action.support.master.TransportMasterNodeOperationAction$3.onTimeout(TransportMasterNodeOperationAction.java:180)",
"org.elasticsearch.cluster.service.InternalClusterService$NotifyTimeout.run(InternalClusterService.java:483)",
"java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)",
"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)",
"java.lang.Thread.run(Thread.java:745)"], :level=>:warn}
{:timestamp=>"2014-09-29T08:36:54.632000-0400", :message=>"Failed to flush
outgoing items", :outgoing_count=>51,
:exception=>org.elasticsearch.discovery.MasterNotDiscoveredException:
waited for [30s],
:backtrace=>["org.elasticsearch.action.support.master.TransportMasterNodeOperationAction$3.onTimeout(TransportMasterNodeOperationAction.java:180)",
"org.elasticsearch.cluster.service.InternalClusterService$NotifyTimeout.run(InternalClusterService.java:483)",
"java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)",
"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)",
"java.lang.Thread.run(Thread.java:745)"], :level=>:warn}
{:timestamp=>"2014-09-29T08:37:25.673000-0400", :message=>"Failed to flush
outgoing items", :outgoing_count=>51,
:exception=>org.elasticsearch.discovery.MasterNotDiscoveredException:
waited for [30s],
:backtrace=>["org.elasticsearch.action.support.master.TransportMasterNodeOperationAction$3.onTimeout(TransportMasterNodeOperationAction.java:180)",
"org.elasticsearch.cluster.service.InternalClusterService$NotifyTimeout.run(InternalClusterService.java:483)",
"java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)",
"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)",
"java.lang.Thread.run(Thread.java:745)"], :level=>:warn}
{:timestamp=>"2014-09-29T08:37:56.735000-0400", :message=>"Failed to flush
outgoing items", :outgoing_count=>51,
:exception=>org.elasticsearch.discovery.MasterNotDiscoveredException:
waited for [30s],
:backtrace=>["org.elasticsearch.action.support.master.TransportMasterNodeOperationAction$3.onTimeout(TransportMasterNodeOperationAction.java:180)",
"org.elasticsearch.cluster.service.InternalClusterService$NotifyTimeout.run(InternalClusterService.java:483)",
"java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)",
"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)",
"java.lang.Thread.run(Thread.java:745)"], :level=>:warn}
Thanks,
Kevin
On Saturday, September 27, 2014 4:34:45 AM UTC-4, Mark Walkom wrote:
>
> Is the cluster external to the LS instance?
> Check the logs of your ES master server, it should show the logstash node
> join, if you aren't seeing that then enable verbose mode in LS and you
> should see the issue.
>
> Regards,
> Mark Walkom
>
> Infrastructure Engineer
> Campaign Monitor
> email: [email protected] <javascript:>
> web: www.campaignmonitor.com
>
> On 27 September 2014 04:28, Kevin M <[email protected] <javascript:>>
> wrote:
>
>> Do i need to set anything up special to have logstash output to my
>> elasticsearch cluster?
>>
>> output {
>> stdout { }
>> elasticsearch {
>> cluster => "es-cluster"
>> }
>> }
>>
>> I have my logstash output setup this way but I do not get anything in
>> kibana - when I switch to elasticsearch_http it works fine and data shows up
>>
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "elasticsearch" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to [email protected] <javascript:>.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/elasticsearch/1a4094e7-2457-4790-9a0e-5cec5bb7b12c%40googlegroups.com
>>
>> <https://groups.google.com/d/msgid/elasticsearch/1a4094e7-2457-4790-9a0e-5cec5bb7b12c%40googlegroups.com?utm_medium=email&utm_source=footer>
>> .
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/e2353e6e-bb64-4f60-bc63-fc5a3d7a6ac3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
