Re: [Openstack-operators] Migrating glance images to a new backend

[Fei Long Wang]

Hi Massimo,

Though I don't have experience on the migration, but as the glance RBD
driver maintainer and image service maintainer of our public cloud
(Catalyst Cloud based in NZ), I'm happy to provide some information.
Before I talk more, would you mind sharing some information of your
environment?

1. Are you using CoW of Ceph?

2. Are you using multi locations? 

show_multiple_locations=True

3. Are you expecting to migrate all the images in a maintenance time
window or you want to keep the glance service running for end user
during the migration?

4. Is it a public cloud?


On 25/03/17 04:55, Massimo Sgaravatto wrote:
> Hi
>
> In our Mitaka cloud we are currently using Gluster as storage backend
> for Glance and Cinder.
> We are now starting the migration to ceph: the idea is then to dismiss
> gluster when we have done.
>
> I have a question concerning Glance. 
>
> I have understood (or at least I hope so) how to add ceph as store
> backend for Glance so that new images will use ceph while the
> previously created ones on the file backend will be still usable.
>
> My question is how I can migrate the images from the file backend to
> ceph when I decide to dismiss the gluster based storage.
>
> The only documentation I found is this one:
>
> https://dmsimard.com/2015/07/18/migrating-glance-images-to-a-different-backend/
>
>
> Could you please confirm that there aren't other better (simpler)
> approaches for such image migration ?
>
> Thanks, Massimo
>
>
> ___
> OpenStack-operators mailing list
> OpenStack-operators@lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

-- 
Cheers & Best regards,
Feilong Wang (王飞龙)
--
Senior Cloud Software Engineer
Tel: +64-48032246
Email: flw...@catalyst.net.nz
Catalyst IT Limited
Level 6, Catalyst House, 150 Willis Street, Wellington
-- 

___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

[Openstack-operators] Fwd: [openstack-dev] Project Navigator Updates - Feedback Request

[Melvin Hillsman]

For those interested.


-- Forwarded message --
From: Lauren Sell 
Date: Fri, Mar 24, 2017 at 11:57 AM
Subject: [openstack-dev] Project Navigator Updates - Feedback Request
To: "OpenStack Development Mailing List (not for usage questions)" <
openstack-...@lists.openstack.org>


Hi everyone,

We’ve been talking for some time about updating the project navigator, and
we have a draft ready to share for community feedback before we launch and
publicize it. One of the big goals coming out of the joint TC/UC/Board
meeting a few weeks ago[1] was to help better communicate ‘what is
openstack?’ and this is one step in that direction.

A few goals in mind for the redesign:
- Represent all official, user-facing projects and deployment services in
the navigator
- Better categorize the projects by function in a way that makes sense to
prospective users (this may evolve over time as we work on mapping the
OpenStack landscape)
- Help users understand which projects are mature and stable vs emerging
- Highlight popular project sets and sample configurations based on
different use cases to help users get started

For a bit of context, we’re working to give each OpenStack official project
a stronger platform as we think of OpenStack as a framework of composable
infrastructure services that can be used individually or together as a
powerful system. This includes the project mascots (so we in effect have
logos to promote each component separately), updates to the project
navigator, and bringing back the “project updates” track at the Summit to
give each PTL/core team a chance to provide an update on their project
roadmap (to be recorded and promoted in the project navigator among other
places!).

We want your feedback on the project navigator v2 before it launches.
Please take a look at the current version on the staging site and provide
feedback on this thread.

http://devbranch.openstack.org/software/project-navigator/

Please review the overall concept and the data and description for your
project specifically. The data is primarily pulled from TC tags[2] and Ops
tags[3]. You’ll notice some projects have more information available than
others for various reasons. That’s one reason we decided to downplay the
maturity metric for now and the data on some pages is hidden. If you think
your project is missing data, please check out the repositories and submit
changes or again respond to this thread.

Also know this will continue to evolve and we are open to feedback. As I
mentioned, a team that formed at the joint strategy session a few weeks ago
is tackling how we map OpenStack projects, which may be reflected in the
categories. And I suspect we’ll continue to build out additional tags and
better data sources to be incorporated.

Thanks for your feedback and help.

Best,
Lauren

[1] http://superuser.openstack.org/articles/community-leadership-charts-
course-openstack/
[2] https://governance.openstack.org/tc/reference/tags/
[3] https://wiki.openstack.org/wiki/Operations/Tags


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 
Kind regards,

Melvin Hillsman
Ops Technical Lead
OpenStack Innovation Center

mrhills...@gmail.com
phone: (210) 312-1267
mobile: (210) 413-1659
http://osic.org

Learner | Ideation | Belief | Responsibility | Command
___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

Re: [Openstack-operators] backup to object store - tool recommendations

[John Dickinson]

On 27 Mar 2017, at 4:39, Blair Bethwaite wrote:

> Hi all,
>
> Does anyone have any recommendations for good tools to perform
> file-system/tree backups and restores to/from a (Ceph RGW-based)
> object store (Swift or S3 APIs)? Happy to hear about both FOSS and
> commercial options please.
>
> I'm interested in:
> 1) tools known to work or not work at all for a basic file-based data backup

There's a bunch of backup tools that will work with the Swift API and/or the S3 
API.

Veritas, Commvault, Trilio, and CloudBerry all work. There's other companies 
too that can back specific stuff up to Swift (e.g. Percona with MySQL).

(The above list taken from https://www.swiftstack.com/solutions/backup [my 
employer] because it's the first linkable place I knew of to answer your 
question.)


--John




>
> Plus these extras:
> 2) preserves/restores correct file metadata (e.g. owner, group, acls etc)
> 3) preserves/restores xattrs
> 4) backs up empty directories and files
> 5) supports some sort of snapshot/versioning/differential
> functionality, i.e., will keep a copy or diff or last N versions of a
> file or whole backup set, e.g., so that one can restore yesterday's
> file/s or last week's but not have to keep two full copies to achieve
> it
> 6) is readily able to restore individual files
> 7) can encrypt/decrypt client side
> 8) anything else I should be considering?
>
> -- 
> Cheers,
> ~Blairo
>
> ___
> OpenStack-operators mailing list
> OpenStack-operators@lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators


signature.asc
Description: OpenPGP digital signature
___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

[Openstack-operators] Boston Forum Reminder

[Melvin Hillsman]

Hey everyone,

This is  a friendly reminder that all proposed Forum session leaders must
submit their abstracts at:

http://forumtopics.openstack.org/

*before 11:59PM UTC on Sunday April 2nd!*

Regards,

TC/UC
___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

[Openstack-operators] [openstack-ansible] Way to cleanup existing Openstack-Ansible deployment

[Amit Kumar]

Hi All,

I am trying to install Openstack Newton using OSA 14.0.8. Playbooks
setup-hosts.yml and setup-infrastructure.yml are getting stuck at some
point or other. Is there any way to cleanup everything which OSA has
deployed. I want to re-run all the playbooks as if I am doing a fresh
deployment.

Thanks.

Regards,
Amit
___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

Re: [Openstack-operators] Memory usage of guest vms, ballooning and nova

[Jay Pipes]

On 03/23/2017 01:01 PM, Jean-Philippe Methot wrote:

Hi,

Lately, on my production openstack Newton setup, I've ran into a
situation that defies my assumptions regarding memory management on
Openstack compute nodes and I've been looking for explanations.
Basically, we had a VM with a flavor that limited it to 96 GB of ram,
which, to be quite honest, we never thought we could ever reach. This is
a very important VM where we wanted to avoid running out of memory at
all cost. The VM itself generally uses about 12 GB of ram.

We were surprised when we noticed yesterday that this VM, which has been
running for several months, was using all its 96 GB on the compute host.
Despite that, in the guest, the OS was indicating a memory usage of
about 12 GB. The only explanation I see to this is that at some point in
time, the host had to allocate all the 96GB of ram to the VM process and
it never took back the allocated ram. This prevented the creation of
more guests on the node as it was showing it didn't have enough memory
left.

Now, I was under the assumption that memory ballooning was integrated
into nova and that the amount of allocated memory to a specific guest
would deflate once that guest did not need the memory. After
verification, I've found blueprints for it, but I see no trace of any
implementation anywhere.

I also notice that on most of our compute nodes, the amount of ram used
is much lower than the amount of ram allocated to VMs, which I do
believe is normal.

So basically, my question is, how does openstack actually manage ram
allocation? Will it ever take back the unused ram of a guest process?
Can I force it to take back that ram?


Basically, you are using a hammer as a screwdriver.

The tool that Nova gives you to prevent other VMs from consuming memory 
allocated to another VM is called the ram_allocation_ratio. By default, 
this is set to 1.5, meaning that if you have 100GB of RAM on a compute 
host, you can allocate VMs that would consume up to 150GB of RAM.


For your VM that has 12GB of RAM used but 96GB allocated, you do not 
want to do that. Instead, give that VM around 16GB of memory, set your 
compute host's ram_allocation_ratio (in nova.conf) to 1.0 and then 
instances on that compute host will not be able to consume more RAM than 
is available on the host.


Best,
-jay

___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

Re: [Openstack-operators] [telecom-nfv] Boston Forum Topics

[Curtis]

Cool thanks Shintaro.

I also added a section on multi-site/distributed cloud.

I will probably submit a entry in the forum system for that.

Thanks,
Curtis.

On Thu, Mar 23, 2017 at 7:54 PM, Shintaro Mizuno
 wrote:
> Thank you for the reminder, Curtis,
>
> I've added few lines and some +1s to the etherpad.
>
> Cheers,
> Shintaro
>
>
> On 2017/03/24 1:54, Curtis wrote:
>>
>> Hi All,
>>
>> In our meeting yesterday we talked about how there is a forum
>> submission process for the Boston Summit.
>>
>> We looked over the brainstorming etherpad [1] for NFV and decided that
>> we didn't quite have time in the meeting to make any recommendations
>> for sessions in that meeting, and that we would try to discuss it on
>> the mailing list, and see if we should be submitting anything, or
>> perhaps adding to the etherpad.
>>
>> There are not a lot of votes for items on the etherpad, most have
>> 0,1,2 votes, one has 5. (I'm not much help here b/c I only looked at
>> that etherpad yesterday.)
>>
>> Also, there is the LCOO and OPNFV groups which have their own
>> processes and procedures, and have likely considered various topics
>> for discussion at the forum.
>>
>> So if anyone has any suggestions or comments on what we should do
>> here, we'd love to hear them. :)
>>
>> Thanks,
>> Curtis.
>>
>> [1]: https://etherpad.openstack.org/p/BOS-UC-brainstorming-Telecom
>>
>> ___
>> OpenStack-operators mailing list
>> OpenStack-operators@lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>>
>>
>
>
> --
> Shintaro MIZUNO (水野伸太郎)
> NTT Software Innovation Center
> TEL: 0422-59-4977
> E-mail: mizuno.shint...@lab.ntt.co.jp
>
>
>
> ___
> OpenStack-operators mailing list
> OpenStack-operators@lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators



-- 
Blog: serverascode.com

___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

Re: [Openstack-operators] backup to object store - tool recommendations

[Joe Topjian]

We use rclone quite a bit. It works great and has a wealth of features:

http://rclone.org/


On Mon, Mar 27, 2017 at 7:50 AM, Nick Jones 
wrote:

> On 27 Mar 2017, at 12:59, Marcus Furlong  wrote:
>
>
> On 27 March 2017 at 22:39, Blair Bethwaite 
> wrote:
>
> Hi all,
>
> Does anyone have any recommendations for good tools to perform
> file-system/tree backups and restores to/from a (Ceph RGW-based)
> object store (Swift or S3 APIs)? Happy to hear about both FOSS and
> commercial options please.
>
>
> [..]
>
>
> I've used duplicity before and it seems to provide most of the
> features you are looking for (not sure about xattrs though):
>
>   http://duplicity.nongnu.org/
>
> S3 and Swift are both supported.
>
>
> +1 for Duplicity - we’ve used it with a degree of success for backups of
> various internal systems.
>
> I can also recommend CloudBerry Backup: https://www.
> cloudberrylab.com/backup.aspx
>
> And for personal stuff on MacOS and Windows Arq is great:
> https://www.arqbackup.com
>
> Cheers.
>
> —
>
> -Nick
>
> DataCentred Limited registered in England and Wales no. 05611763
> ___
> OpenStack-operators mailing list
> OpenStack-operators@lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>
>
___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

Re: [Openstack-operators] backup to object store - tool recommendations

[Nick Jones]

On 27 Mar 2017, at 12:59, Marcus Furlong  wrote:
> 
> On 27 March 2017 at 22:39, Blair Bethwaite  > wrote:
>> Hi all,
>> 
>> Does anyone have any recommendations for good tools to perform
>> file-system/tree backups and restores to/from a (Ceph RGW-based)
>> object store (Swift or S3 APIs)? Happy to hear about both FOSS and
>> commercial options please.

[..]

> 
> I've used duplicity before and it seems to provide most of the
> features you are looking for (not sure about xattrs though):
> 
>   http://duplicity.nongnu.org/ 
> 
> S3 and Swift are both supported.

+1 for Duplicity - we’ve used it with a degree of success for backups of 
various internal systems.

I can also recommend CloudBerry Backup: 
https://www.cloudberrylab.com/backup.aspx

And for personal stuff on MacOS and Windows Arq is great: 
https://www.arqbackup.com

Cheers.

— 

-Nick
-- 
DataCentred Limited registered in England and Wales no. 05611763
___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

Re: [Openstack-operators] backup to object store - tool recommendations

[Marcus Furlong]

On 27 March 2017 at 22:39, Blair Bethwaite  wrote:
> Hi all,
>
> Does anyone have any recommendations for good tools to perform
> file-system/tree backups and restores to/from a (Ceph RGW-based)
> object store (Swift or S3 APIs)? Happy to hear about both FOSS and
> commercial options please.
>
> I'm interested in:
> 1) tools known to work or not work at all for a basic file-based data backup
>
> Plus these extras:
> 2) preserves/restores correct file metadata (e.g. owner, group, acls etc)
> 3) preserves/restores xattrs
> 4) backs up empty directories and files
> 5) supports some sort of snapshot/versioning/differential
> functionality, i.e., will keep a copy or diff or last N versions of a
> file or whole backup set, e.g., so that one can restore yesterday's
> file/s or last week's but not have to keep two full copies to achieve
> it
> 6) is readily able to restore individual files
> 7) can encrypt/decrypt client side
> 8) anything else I should be considering?

I've used duplicity before and it seems to provide most of the
features you are looking for (not sure about xattrs though):

   http://duplicity.nongnu.org/

S3 and Swift are both supported.

There are also a bunch of duplicity frontends available; e.g. duply,
deja-dup, duplicati, etc.

Cheers,
Marcus.

-- 
Marcus Furlong

___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators

[Openstack-operators] backup to object store - tool recommendations

[Blair Bethwaite]

Hi all,

Does anyone have any recommendations for good tools to perform
file-system/tree backups and restores to/from a (Ceph RGW-based)
object store (Swift or S3 APIs)? Happy to hear about both FOSS and
commercial options please.

I'm interested in:
1) tools known to work or not work at all for a basic file-based data backup

Plus these extras:
2) preserves/restores correct file metadata (e.g. owner, group, acls etc)
3) preserves/restores xattrs
4) backs up empty directories and files
5) supports some sort of snapshot/versioning/differential
functionality, i.e., will keep a copy or diff or last N versions of a
file or whole backup set, e.g., so that one can restore yesterday's
file/s or last week's but not have to keep two full copies to achieve
it
6) is readily able to restore individual files
7) can encrypt/decrypt client side
8) anything else I should be considering?

-- 
Cheers,
~Blairo

___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators