On Tue, 8 Dec 2020 at 17:54, Andrey Borodin wrote:
> > In pglogical3 we already support streaming decoded WAL data to
> alternative writer downstreams including RabbitMQ and Kafka via writer
> plugins.
> Yes, Yandex.Cloud Transfer Manger supports it too. But it has to be
> resynced after physica
Thanks Craig!
Probably, I should better ask in your nearby thread about logical replication,
it just seemed to me that logical archiving is somewhat small independent piece
of functionality...
> 7 дек. 2020 г., в 08:05, Craig Ringer
> написал(а):
>
> Reply follows inline. I ad
On Mon, Dec 7, 2020 at 8:35 AM Craig Ringer
wrote:
>
> Reply follows inline. I addressed your last point first, so it's out of order.
>
> On Fri, 4 Dec 2020 at 15:33, Andrey Borodin wrote
>
> We'd also need to separate the existing apply worker into a "receiver" and
> "apply/writer" part, so the
sing problems of CDC with scientific community and they
> asked this simple question: "So you have efficient WAL archive on a very
> cheap storage, why don't you have a logical archive too?"
>
> I've done work in this area, as has Petr (CC'd).
>
> In short, logi
27;ve done work in this area, as has Petr (CC'd).
In short, logical archiving and PITR is very much desirable, but we're not
nearly ready for it yet and we're missing a lot of the foundations needed
to make it really useful.
IMO the strongest pre-requisite is that we need integrate
On Fri, 4 Dec 2020 at 14:36, Andrey Borodin wrote:
> >
> > The most time consuming process is logical decoding, mainly due to long
> running transactions.
> Currently I do not experience problem of high CPU utilisation.
>
> I'm wondering why the LSN isn't moving fast enough for your use case.
>
Hi Euler!
Thanks for your response.
> 4 дек. 2020 г., в 22:14, Euler Taveira
> написал(а):
>
> On Fri, 4 Dec 2020 at 04:33, Andrey Borodin wrote:
>
> I was discussing problems of CDC with scientific community and they asked
> this simple question: "So you have efficient WAL archive on a ver
On Fri, 4 Dec 2020 at 04:33, Andrey Borodin wrote:
>
> I was discussing problems of CDC with scientific community and they asked
> this simple question: "So you have efficient WAL archive on a very cheap
> storage, why don't you have a logical archive too?"
>
WAL archive doesn't process data; it
Hi all
I was discussing problems of CDC with scientific community and they asked this
simple question: "So you have efficient WAL archive on a very cheap storage,
why don't you have a logical archive too?"
This seems like a wild idea. But really, we have a super expensive NVMe drives
for OLTP w
