Re: [ceph-users] Bluestore caching, flawed by design?

2018-04-02 Thread Mark Nelson
On 04/01/2018 07:59 PM, Christian Balzer wrote: Hello, firstly, Jack pretty much correctly correlated my issues to Mark's points, more below. On Sat, 31 Mar 2018 08:24:45 -0500 Mark Nelson wrote: On 03/29/2018 08:59 PM, Christian Balzer wrote: Hello, my crappy test cluster was rendered

Re: [ceph-users] Bluestore caching, flawed by design?

2018-04-02 Thread Simon Leinen
Christian Balzer writes: > On Mon, 2 Apr 2018 08:33:35 +0200 John Hearns wrote: >> Christian, you mention single socket systems for storage servers. >> I often thought that the Xeon-D would be ideal as a building block for >> storage servers >>

Re: [ceph-users] Bluestore caching, flawed by design?

2018-04-02 Thread Christian Balzer
Hello, On Mon, 2 Apr 2018 08:33:35 +0200 John Hearns wrote: > Christian, you mention single socket systems for storage servers. > I often thought that the Xeon-D would be ideal as a building block for > storage servers >

Re: [ceph-users] Bluestore caching, flawed by design?

2018-04-02 Thread John Hearns
Christian, you mention single socket systems for storage servers. I often thought that the Xeon-D would be ideal as a building block for storage servers https://www.intel.com/content/www/us/en/products/processors/xeon/d-processors.html Low power, and a complete System-On-Chip with 10gig Ethernet.

Re: [ceph-users] Bluestore caching, flawed by design?

2018-04-02 Thread John Hearns
> A long time ago I was responsible for validating the performance of CXFS on an SGI Altix UV distributed shared-memory supercomputer. As it turns out, we could achieve about 22GB/s writes with XFS (a huge >number at the time), but CXFS was 5-10x slower. A big part of that turned out to be the

Re: [ceph-users] Bluestore caching, flawed by design?

2018-04-01 Thread Christian Balzer
Hello, firstly, Jack pretty much correctly correlated my issues to Mark's points, more below. On Sat, 31 Mar 2018 08:24:45 -0500 Mark Nelson wrote: > On 03/29/2018 08:59 PM, Christian Balzer wrote: > > > Hello, > > > > my crappy test cluster was rendered inoperational by an IP renumbering > >

Re: [ceph-users] Bluestore caching, flawed by design?

2018-03-31 Thread Jack
On 03/31/2018 03:24 PM, Mark Nelson wrote: >> 1. Completely new users may think that bluestore defaults are fine and >> waste all that RAM in their machines. > > What does "wasting" RAM mean in the context of a node running ceph? Are > you upset that other applications can't come in and evict

Re: [ceph-users] Bluestore caching, flawed by design?

2018-03-31 Thread Mark Nelson
On 03/29/2018 08:59 PM, Christian Balzer wrote: Hello, my crappy test cluster was rendered inoperational by an IP renumbering that wasn't planned and forced on me during a DC move, so I decided to start from scratch and explore the fascinating world of Luminous/bluestore and all the assorted

[ceph-users] Bluestore caching, flawed by design?

2018-03-29 Thread Christian Balzer
Hello, my crappy test cluster was rendered inoperational by an IP renumbering that wasn't planned and forced on me during a DC move, so I decided to start from scratch and explore the fascinating world of Luminous/bluestore and all the assorted bugs. ^_- (yes I could have recovered the cluster