I now have an EBS device mounted at /data on my EC2, Ubuntu 12.04
instance.
My plan was, to:
1. Create /data/elasticsearch
2. Make /data/elasticsearch owned by
3. Set path.data to /data/elasticsearch
4. Reboot the EC2 instance, letting ES start and fill up
/data/elasticsearch with stuff stored on S3
5. Remove the S3 settings from /etc/elasticsearch/elasticsearch.yml
6. Wait until the index doesn't change anymore
7. Reboot the EC2 instance
Unfortunately ES came up again, but without any indices. Should this
have worked? Or will it fail, because if things I don't understand about
how gateways work?
Thanks!
- Steinar
Here are the log messages from the restart after the S3 settings had
been removed:
[2013-12-30 13:06:35,434][INFO ][node ] [Tefral the
Surveyor] version[0.90.7], pid[800], build[36897d0/2013-11-13T12:06:54Z]
[2013-12-30 13:06:35,436][INFO ][node ] [Tefral the
Surveyor] initializing ...
[2013-12-30 13:06:35,585][INFO ][plugins ] [Tefral the
Surveyor] loaded [river-datagen, cloud-aws], sites [head]
[2013-12-30 13:06:38,812][DEBUG][discovery.zen.ping.multicast] [Tefral the
Surveyor] using group [224.2.2.4], with port [54328], ttl [3], and address
[null]
[2013-12-30 13:06:38,817][DEBUG][discovery.zen.ping.unicast] [Tefral the
Surveyor] using initial hosts [], with concurrent_connects [10]
[2013-12-30 13:06:38,819][DEBUG][discovery.ec2 ] [Tefral the
Surveyor] using ping.timeout [3s], master_election.filter_client [true],
master_election.filter_data [false]
[2013-12-30 13:06:38,820][DEBUG][discovery.zen.elect ] [Tefral the
Surveyor] using minimum_master_nodes [-1]
[2013-12-30 13:06:38,822][DEBUG][discovery.zen.fd ] [Tefral the
Surveyor] [master] uses ping_interval [1s], ping_timeout [30s], ping_retries [3]
[2013-12-30 13:06:38,827][DEBUG][discovery.zen.fd ] [Tefral the
Surveyor] [node ] uses ping_interval [1s], ping_timeout [30s], ping_retries [3]
[2013-12-30 13:06:40,008][DEBUG][discovery.ec2 ] [Tefral the
Surveyor] using host_type [PRIVATE_IP], tags [{}], groups [[]] with any_group
[true], availability_zones [[]]
[2013-12-30 13:06:41,503][DEBUG][gateway.local ] [Tefral the
Surveyor] using initial_shards [quorum], list_timeout [30s]
[2013-12-30 13:06:41,904][DEBUG][gateway.local.state.meta ] [Tefral the
Surveyor] using gateway.local.auto_import_dangled [YES], with
gateway.local.dangling_timeout [2h]
[2013-12-30 13:06:41,906][DEBUG][gateway.local.state.meta ] [Tefral the
Surveyor] [_river] failed to find metadata for existing index location
[2013-12-30 13:06:41,907][DEBUG][gateway.local.state.meta ] [Tefral the
Surveyor] [my_index] failed to find metadata for existing index location
[2013-12-30 13:06:41,907][DEBUG][gateway.local.state.meta ] [Tefral the
Surveyor] took 3ms to load state
[2013-12-30 13:06:41,916][DEBUG][gateway.local.state.shards] [Tefral the
Surveyor] took 9ms to load started shards state
[2013-12-30 13:06:41,944][INFO ][node ] [Tefral the
Surveyor] initialized
[2013-12-30 13:06:41,945][INFO ][node ] [Tefral the
Surveyor] starting ...
[2013-12-30 13:06:42,147][INFO ][transport ] [Tefral the
Surveyor] bound_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish_address
{inet[/172.31.31.127:9300]}
[2013-12-30 13:06:42,168][TRACE][discovery ] [Tefral the
Surveyor] waiting for 30s for the initial state to be set by the discovery
[2013-12-30 13:06:43,304][TRACE][discovery.ec2 ] [Tefral the
Surveyor] building dynamic unicast discovery nodes...
[2013-12-30 13:06:43,304][DEBUG][discovery.ec2 ] [Tefral the
Surveyor] using dynamic discovery nodes []
[2013-12-30 13:06:44,979][TRACE][discovery.ec2 ] [Tefral the
Surveyor] building dynamic unicast discovery nodes...
[2013-12-30 13:06:44,979][DEBUG][discovery.ec2 ] [Tefral the
Surveyor] using dynamic discovery nodes []
[2013-12-30 13:06:46,632][TRACE][discovery.ec2 ] [Tefral the
Surveyor] building dynamic unicast discovery nodes...
[2013-12-30 13:06:46,632][DEBUG][discovery.ec2 ] [Tefral the
Surveyor] using dynamic discovery nodes []
[2013-12-30 13:06:46,633][TRACE][discovery.ec2 ] [Tefral the
Surveyor] full ping responses: {none}
[2013-12-30 13:06:46,633][DEBUG][discovery.ec2 ] [Tefral the
Surveyor] filtered ping responses: (filter_client[true], filter_data[false])
{none}
[2013-12-30 13:06:46,641][INFO ][cluster.service ] [Tefral the
Surveyor] new_master [Tefral the
Surveyor][rOtRMCncTPy7-jnjO1B_5g][inet[/172.31.31.127:9300]], reason:
zen-disco-join (elected_as_master)
[2013-12-30 13:06:46,690][TRACE][discovery ] [Tefral the
Surveyor] initial state set from discovery
[2013-12-30 13:06:46,690][INFO ][discovery ] [Tefral the
Surveyor] csisearch-cluster/rOtRMCncTPy7-jnjO1B_5g
[2013-12-30 13:06:46,698][DEBUG][gateway.local.state.meta ] [Tefral the
Surveyor] [_river] failed to find metadata for existing index location
[2013-12-30 13:06:46,699][DEBUG][gateway.local.state.meta ] [Tefral the
Surveyor] [my_index] failed to find metadata for existing index location
[2013-12-30 13:06:46,750][INFO ][http ] [Tefral the
Surveyor] bound_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish_address
{inet[/172.31.31.127:9200]}
[2013-12-30 13:06:46,750][INFO ][node ] [Tefral the
Surveyor] started
[2013-12-30 13:06:46,871][INFO ][gateway ] [Tefral the
Surveyor] recovered [0] indices into cluster_state
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/87d2kee906.fsf_-_%40dod.no.
For more options, visit https://groups.google.com/groups/opt_out.
