Hi all,

The Toolforge Elasticsearch cluster is being replaced with a cluster
based on OpenSearch v2[0]. If your tool uses the writable
Elastic/OpenSearch functionality you will need to manually migrate
your tool to the new cluster as described in the rest of this email.
(Note that this is different from the "Cloud Elastic" service which
provides read-only access to the search indexes of Wikimedia wikis.)

The Wikitech page[0] has been updated with the details of the new
cluster, which are almost identical to the previous cluster except the
hostname and software version used. The same set of credentials will
also work on the new cluster. There are, however, some breaking API
changes between the old version and the new one, which is why we are
not just migrating all indexes for all tools at once.

To help migrate data from the old cluster to the new one, we have
temporarily added a `toolforge migrate-index` command to the bastion
servers to copy over an index and its mappings, aliases and
replication settings. The tool takes a space-separated list of indexes
to migrate, and will use credentials saved as envvars by default (and
prompt you if those are not available). Migration is relatively quick,
in my tests an index with about 400k records and 1+1 replication takes
about a minute to migrate.

The old Elasticsearch cluster will be shut down on 24 August.

This work is tracked as T401818.[1]

[0]: https://wikitech.wikimedia.org/wiki/Help:Toolforge/OpenSearch
[1]: https://phabricator.wikimedia.org/T401818

-- 
Taavi Väänänen (he/they)
Site Reliability Engineer, Tools Infrastructure
Wikimedia Foundation
_______________________________________________
Cloud-announce mailing list -- [email protected]
List information: 
https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.org/

Reply via email to