Re: [ceph-users] Crushmap and failure domains at rack level (ideally data-center level in the future)

2018-10-25 Thread Waterbly, Dan
I think I was able to figure out what happened. Some of my rgw pools had a min_size of 1 and some had a min_size of 2. I am not certain how this happened but my theory is I must have had at least one of the pools created before I modified the crushmap rules. After the rule was modified new

Re: [ceph-users] Crushmap and failure domains at rack level (ideally data-center level in the future)

2018-10-25 Thread Waterbly, Dan
Sorry for the delay but ceph osd pool get min_size returns 1. Where does this value come from? Get Outlook for iOS On Tue, Oct 23, 2018 at 5:47 PM -0700, "Bastiaan Visser" mailto:bvis...@flexyz.com>> wrote: Something must be wrong, since you have min_size 3 the pool

Re: [ceph-users] RGW: move bucket from one placement to another

2018-10-25 Thread David Turner
Resharding a bucket won't affect the data in the bucket. After you change the placement for a bucket, you could update where the data is by re-writing all of the data in the bucket. On Thu, Oct 25, 2018 at 8:48 AM Jacek Suchenia wrote: > Hi > > We have a bucket created with LocationConstraint

[ceph-users] Upcoming CFPs and conferences of interest

2018-10-25 Thread Gregory Farnum
Hey all, several of these conferences have been mentioned on the list but I wanted to draw your attention to them in aggregate. The CFPs of interest I know about are gathered in https://pad.ceph.com/p/cfp-coordination (and that etherpad is open for edits from anybody!). In particular: * Closing

[ceph-users] IO500 CFS for SC18

2018-10-25 Thread John Bent
Dear all, The IO500 is now accepting and encouraging submissions for the upcoming IO500 list revealed at Supercomputing 2018 in Dallas, Texas. We also announce the 10 compute node I/O challenge to encourage submission of small-scale results. The new ranked lists will be announced at our SC18 BOF

[ceph-users] Ceph mds memory leak while replay

2018-10-25 Thread Johannes Schlueter
Hello, os: ubuntu bionic lts ceph v12.2.7 luminous (on one node we updated to ceph-mds 12.2.8 with no luck) 2 mds and 1 backup mds we just experienced a problem while restarting a mds. As it has begun to replay the journal, the node ran out of memory. A restart later, after giving about 175GB of

Re: [ceph-users] NVME Intel Optane - same servers different performance

2018-10-25 Thread Steven Vacaroaia
Just an update - maybe will help others I've downloaded and ran Intel firmware update ISO Although the tool confirmed firmware was current ( no update necessary) , after I rebooted, the performance was similar with the other 3 servers Odd but.. nothing is/was making sense Steven On Thu, 25 Oct

Re: [ceph-users] Migrate/convert replicated pool to EC?

2018-10-25 Thread David Turner
There are no tools to migrate in either direction between EC and Replica. You can't even migrate an EC pool to a new EC profile. With RGW you can create a new data pool and new objects will be written to the new pool. If your objects have a lifecycle, then eventually you'll be to the new pool

Re: [ceph-users] NVME Intel Optane - same servers different performance

2018-10-25 Thread Steven Vacaroaia
Thanks for suggestion However same "bad"server was working fine until I updated firmware Now, all 4 server have the same firmware but one has lower performance I will try what you suggested though although, as I said, same server with same NVME had good performance before updating server firmware

[ceph-users] Migrate/convert replicated pool to EC?

2018-10-25 Thread Matthew Vernon
Hi, I thought I'd seen that it was possible to migrate a replicated pool to being erasure-coded (but not the converse); but I'm failing to find anything that says _how_. Have I misremembered? Can you migrate a replicated pool to EC? (if so, how?) ...our use case is moving our S3 pool which

Re: [ceph-users] NVME Intel Optane - same servers different performance

2018-10-25 Thread Martin Verges
Hello Steven, You could swap the SSDs from the hosts to see if the error is migrating. If it migrates, I would appreciate that the affected SSD simply offers less performance than the others. Possibly an RMA reason depending on what the manufacturer guarantees. If not, the system must be further

Re: [ceph-users] NVME Intel Optane - same servers different performance

2018-10-25 Thread Steven Vacaroaia
Hi Martin, Yes, they are in the same slot - also I checked the BIOS and the PCI speed and type is properly negotiated system profile ( performance) note This happened after I upgrade firmware on the servers - however they all have the same firmware BAD server lspci | grep -i Optane

Re: [ceph-users] NVME Intel Optane - same servers different performance

2018-10-25 Thread Martin Verges
Hello Steven, are you sure that the systems are exact the same? Sometimes vendors place extension cards into different PCIe slots. -- Martin Verges Managing director Mobile: +49 174 9335695 E-Mail: martin.ver...@croit.io Chat: https://t.me/MartinVerges croit GmbH, Freseniusstr. 31h, 81247

[ceph-users] NVME Intel Optane - same servers different performance

2018-10-25 Thread Steven Vacaroaia
Hi, I have 4 x DELL R630 servers with exact same specs I installed Intel Optane SSDPED1K375GA in all When comparing fio performance ( both read and write), when is lower than the other 3 ( see below - just read) Any suggestions as to what to check/fix ? BAD server [root@osd04 ~]# fio

Re: [ceph-users] [Ceph Days 2017] Short movie from 3D presentation (ceph + blender + python)

2018-10-25 Thread John Spray
On Thu, Oct 25, 2018 at 9:31 AM igor.podo...@ts.fujitsu.com wrote: > > Hello Cephers! > > For those of you who like puzzles, here > https://www.youtube.com/watch?v=vWbK4L77aEE is the movie from our 3D > presentation that we made especially for Ceph Days Warsaw 2017. > > The movie contains 3

[ceph-users] RGW: move bucket from one placement to another

2018-10-25 Thread Jacek Suchenia
Hi We have a bucket created with LocationConstraint setting, so explicit_placement entries are filled in a bucket. Is there a way to move it to other placement? I was thinking about editing that data and run manual resharding, but I don't know if it's a correct way of solving this problem. Jacek

[ceph-users] FW: [Ceph Days 2017] Short movie from 3D presentation (ceph + blender + python)

2018-10-25 Thread igor.podo...@ts.fujitsu.com
Resending. -Original Message- From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of igor.podo...@ts.fujitsu.com Sent: Thursday, October 25, 2018 10:31 AM To: ceph-de...@vger.kernel.org; ceph-us...@ceph.com Cc: Mike Perez Subject: [Ceph Days 2017]

[ceph-users] [Ceph Days 2017] Short movie from 3D presentation (ceph + blender + python)

2018-10-25 Thread igor.podo...@ts.fujitsu.com
Hello Cephers! For those of you who like puzzles, here  https://www.youtube.com/watch?v=vWbK4L77aEE is the movie from our 3D presentation that we made especially for Ceph Days Warsaw 2017. The movie contains 3 easter eggs inside (watch in 1080p quality), one is trivial, second is hard, and the