Re: Script which shows performance of ByteA: ascii vs binary

2019-03-22 Thread Thomas Güttler
Am 22.03.19 um 13:40 schrieb Francisco Olarte: Thomas: On Fri, Mar 22, 2019 at 11:22 AM Thomas Güttler wrote: Thank you for asking several times for a benchmark. I wrote it now and it is visible: inserting random bytes into bytea is much slower, if you use the psycopg2 defaults. Here

Re: Performance of ByteA: ascii vs binary

2019-03-20 Thread Thomas Güttler
Am 19.03.19 um 20:37 schrieb Peter J. Holzer: On 2019-03-18 15:33:17 +0100, Thomas Güttler wrote: I did some benchmarking and in my setup there was major performance difference. I tested a ByteA column. If I used ascii data the tests took 52 seconds. If I used random binary data the test

Re: minio server. Was: Performance of ByteA: ascii vs binary

2019-03-19 Thread Thomas Güttler
Am 18.03.19 um 17:52 schrieb Adrian Klaver: On 3/18/19 7:59 AM, Thomas Güttler wrote: Am 18.03.19 um 15:49 schrieb Tom Lane: Adrian Klaver writes: On 3/18/19 7:33 AM, Thomas Güttler wrote: If I used ascii data the tests took 52 seconds. If I used random binary data the test took 250

minio server. Was: Performance of ByteA: ascii vs binary

2019-03-18 Thread Thomas Güttler
Am 18.03.19 um 15:49 schrieb Tom Lane: Adrian Klaver writes: On 3/18/19 7:33 AM, Thomas Güttler wrote: If I used ascii data the tests took 52 seconds. If I used random binary data the test took 250 seconds. This doesn't seem terribly surprising in bytea_output = escape mode. Probably

Performance of ByteA: ascii vs binary

2019-03-18 Thread Thomas Güttler
, or is there something wrong with my benchmark? I used Python and psycopg2. Regards, Thomas Güttler -- Thomas Guettler http://www.thomas-guettler.de/ I am looking for feedback: https://github.com/guettli/programming-guidelines

s3 was: Where to store Blobs?

2019-03-18 Thread Thomas Güttler
I am curious. Why did nobody say: store blobs in a storage server (like s3) and only store the blob-id in PostgreSQL? Regards, Thomas Am 13.03.19 um 15:28 schrieb Thomas Güttler: Some days ago I asked "Where **not** to use PostgreSQL?" on this mailing list. Now I realiz

Where to store Blobs?

2019-03-13 Thread Thomas Güttler
Some days ago I asked "Where **not** to use PostgreSQL?" on this mailing list. Now I realized: Nobody talked about Blobs. I guess most people do not store Blobs in PostgresSQL. Where do you store Blobs? (In my case Blobs are PDF/image files with size up to 20 MByte. I do not talk about very

Thank you. Was: Where **not** to use PostgreSQL?

2019-03-01 Thread Thomas Güttler Lists
Thank you very much for your friendly answers. I added some parts to my guidlines:   https://github.com/guettli/programming-guidelines/blob/master/README.rst#where-to-not-use-postgresql Feedback is welcome. Regards,   Thomas Güttler Am 28.02.19 um 12:47 schrieb Thomas Güttler: Hi

Where **not** to use PostgreSQL?

2019-02-28 Thread Thomas Güttler
Hi experts, where would you suggest someone to **not** use PostgreSQL? Why would you do this? What alternative would you suggest instead? Regards, Thomas Güttler -- Thomas Guettler http://www.thomas-guettler.de/ I am looking for feedback: https://github.com/guettli/programming-guidelines

Re: Use bytearray for blobs or not?

2019-01-07 Thread Thomas Güttler
I came across this article, and now I think blob in s3 in s3-object-id in PostgreSQL are the best solution for me: https://wiki.postgresql.org/wiki/BinaryFilesInDB I hope the wiki page is still valid. Regards, Thomas Am 04.01.19 um 12:41 schrieb Thomas Güttler: Some months ago I wrote

Re: Use bytearray for blobs or not?

2019-01-04 Thread Thomas Güttler
Am 04.01.19 um 12:48 schrieb Achilleas Mantzios: On 4/1/19 1:41 μ.μ., Thomas Güttler wrote: Some months ago I wrote a little application with Python+Django which stores blob data in bytearrays. It works. In the future there will be a lot more traffic, and I am unsure if this is really

Use bytearray for blobs or not?

2019-01-04 Thread Thomas Güttler
Some months ago I wrote a little application with Python+Django which stores blob data in bytearrays. It works. In the future there will be a lot more traffic, and I am unsure if this is really a good solution. I know this is more FUD than concrete PG issue. What do you think? Which

Re: Replicate Tables from SAP (DB2/HANA) to PostgreSQL

2018-09-20 Thread Thomas Güttler
Am 20.09.2018 um 04:19 schrieb bricklen: On Tue, Sep 18, 2018 at 11:31 PM Thomas Güttler mailto:guettl...@thomas-guettler.de>> wrote: Hi, is it possible to replicate some tables from SAP to PostgreSQL? At the moment there are two underlaying database systems. Some r

Replicate Tables from SAP (DB2/HANA) to PostgreSQL

2018-09-19 Thread Thomas Güttler
be unidirectional. The data in PostgreSQL is only needed for reading, not for inserts/updates. Regards, Thomas Güttler -- Thomas Guettler http://www.thomas-guettler.de/ I am looking for feedback: https://github.com/guettli/programming-guidelines