Re: [GENERAL] PostgreSQL and Kubernetes

[Moreno Andreo]

  
  
Il 03/04/2017 22:32, Alex Kliukin ha
  scritto:

as it makes little sense to build an aircraft carrier
  to carry a single Cessna. 

:-) A bit extreme, but it makes the idea ...
Thanks
Moreno.-

  
  
   
  

  Kind
regards,
  --
  Oleksii
“Alex" Kliukin

  
  



  

Re: [GENERAL] PostgreSQL and Kubernetes

[Moreno Andreo]

Il 03/04/2017 18:10, Joe Conway ha scritto:

On 03/31/2017 01:58 AM, Moreno Andreo wrote:

Il 30/03/2017 14:38, Vick Khera ha scritto:

On Thu, Mar 30, 2017 at 6:10 AM, Moreno Andreo
> wrote:

 Since I'm on Google Cloud Platform, I thought it would be a good
 idea to see what it offers.


They currently have in beta a Postgres flavor of their cloudsql. I
haven't used it yet, but I plan to test it sometime in the next couple
of months.

I'm aware of this (and I'm about to test it too), but while this is in
beta I need a solution to keep up with my architecture... I can't stay
with a single server and no backup (except a snapshot of the disk made
on a daily basis... but that's no real backup) waiting for Cloud SQL to
get out of beta...

Take a look at:
https://github.com/CrunchyData/crunchy-containers
This is another good post... but I decided to keep the current 
architecture, adding a standby server managed by repmgr and load 
balanced by PgPool II, with barman taking care of the backup. I don't 
think spending more than a week studying the docs and preparing the 
whole thing in test lab.


If I'm about to migrate to Cloud SQL I think it's not worth the effort 
to create a new structure and migrate in there, just for some time... 
and then migrate again to CloudSQL.


Thanks again
Moreno.-



HTH,

Joe






--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] PostgreSQL and Kubernetes

[Alex Kliukin]

> On 30. Mar 2017, at 12:10, Moreno Andreo  wrote:

> as databases aren't built for type of dynamic scheduling that something like 
> kubernetes (or any other container management solution), due to how they 
> interact with the filesystem, network stack, and more.
> Further more, he suggests that because of this lack of integration, that if 
> you do run your database in kubernetes/docker, you are very likely to 
> encounter data corruption and data loss"
> 
> What's your advice?


I think dynamic scheduling just increases the chances of your database instance 
being killed. Your K8S cluster, if not configured properly, may decide to kill 
your master database pod when scaling down nodes in order to utilise resources 
efficiently.

If you run your PostgreSQL on K8S make sure you have a good and battle-tested 
HA setup, know your way around configuring both PostgreSQL streaming 
replication and Kubernetes cluster, and have a number of databases to manage, 
as it makes little sense to build an aircraft carrier to carry a single Cessna. 

 
Kind regards,
--
Oleksii “Alex" Kliukin

Re: [GENERAL] PostgreSQL and Kubernetes

[Joe Conway]

On 03/31/2017 01:58 AM, Moreno Andreo wrote:
> Il 30/03/2017 14:38, Vick Khera ha scritto:
>>
>> On Thu, Mar 30, 2017 at 6:10 AM, Moreno Andreo
>> > wrote:
>>
>> Since I'm on Google Cloud Platform, I thought it would be a good
>> idea to see what it offers. 
>>
>>
>> They currently have in beta a Postgres flavor of their cloudsql. I
>> haven't used it yet, but I plan to test it sometime in the next couple
>> of months.
> 
> I'm aware of this (and I'm about to test it too), but while this is in
> beta I need a solution to keep up with my architecture... I can't stay
> with a single server and no backup (except a snapshot of the disk made
> on a daily basis... but that's no real backup) waiting for Cloud SQL to
> get out of beta...

Take a look at:
https://github.com/CrunchyData/crunchy-containers

HTH,

Joe

-- 
Crunchy Data - http://crunchydata.com
PostgreSQL Support for Secure Enterprises
Consulting, Training, & Open Source Development



signature.asc
Description: OpenPGP digital signature

Re: [GENERAL] PostgreSQL and Kubernetes

[Moreno Andreo]

  
  
Il 30/03/2017 14:38, Vick Khera ha
  scritto:


  

  On Thu, Mar 30, 2017 at 6:10 AM,
Moreno Andreo 
wrote:
Since
  I'm on Google Cloud Platform, I thought it would be a good
  idea to see what it offers. 
  
  
  They currently have in beta a Postgres flavor of their
  cloudsql. I haven't used it yet, but I plan to test it
  sometime in the next couple of months.
  

I'm aware of this (and I'm about to test it too), but while this
  is in beta I need a solution to keep up with my architecture... I
  can't stay with a single server and no backup (except a snapshot
  of the disk made on a daily basis... but that's no real backup)
  waiting for Cloud SQL to get out of beta...

  

Re: [GENERAL] PostgreSQL and Kubernetes

[Moreno Andreo]

Il 30/03/2017 15:27, Adrian Klaver ha scritto:

On 03/30/2017 03:10 AM, Moreno Andreo wrote:


Hi everyone,
I was googling around while searching stuff to finish my cluster
solution (already running in production in single-server mode) with
barman and pgbouncer, when I ran into this

https://hackernoon.com/postgresql-cluster-into-kubernetes-cluster-f353cde212de 



Since I'm on Google Cloud Platform, I thought it would be a good idea to
see what it offers. 

[snip]

What's your advice?


I don't us eKubernetes, 
neither do I, at the moment. but if there's to dig into something 
new, I'm always ready!



but I do know one of the former members of the Postgres Core does:

https://opensource.com/article/17/2/stateful-applications

That's a *niiice* article!


and delivered a talk at Scale15x on it:

http://www.socallinuxexpo.org/scale/15x/presentations/ccp-containerized-clustered-postgres 



https://www.youtube.com/watch?v=mxmZv9xkc8s

I'll take a look later

Thanks a lot!!!
Best regards
Moreno.


Go to about 3 minutes in on the video as there are sound/video issues 
before that.




Thanks in advance,
Moreno








--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] PostgreSQL and Kubernetes

[Adrian Klaver]

On 03/30/2017 03:10 AM, Moreno Andreo wrote:


Hi everyone,
I was googling around while searching stuff to finish my cluster
solution (already running in production in single-server mode) with
barman and pgbouncer, when I ran into this

https://hackernoon.com/postgresql-cluster-into-kubernetes-cluster-f353cde212de

Since I'm on Google Cloud Platform, I thought it would be a good idea to
see what it offers. After a quick read, I found a comment saying
*"There was a series of comments by Kelsey Hightower about running
databases in Kubernetes, both at conferences and on Twitter; he
essentially says that you should absolutely NOT run your database in a
container/kubernetes pod/service/deployment, as databases aren't built
for type of dynamic scheduling that something like kubernetes (or any
other container management solution), due to how they interact with the
filesystem, network stack, and more.*
*Further more, he suggests that because of this lack of integration,
that if you do run your database in kubernetes/docker, you are very
likely to encounter data corruption and data loss"*

What's your advice?


I don't us eKubernetes, but I do know one of the former members of the 
Postgres Core does:


https://opensource.com/article/17/2/stateful-applications

and delivered a talk at Scale15x on it:

http://www.socallinuxexpo.org/scale/15x/presentations/ccp-containerized-clustered-postgres

https://www.youtube.com/watch?v=mxmZv9xkc8s

Go to about 3 minutes in on the video as there are sound/video issues 
before that.




Thanks in advance,
Moreno



--
Adrian Klaver
adrian.kla...@aklaver.com


--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] PostgreSQL and Kubernetes

[Vick Khera]

On Thu, Mar 30, 2017 at 6:10 AM, Moreno Andreo 
wrote:

> Since I'm on Google Cloud Platform, I thought it would be a good idea to
> see what it offers.


They currently have in beta a Postgres flavor of their cloudsql. I haven't
used it yet, but I plan to test it sometime in the next couple of months.