Many thanks for this.
On Mon, Feb 13, 2017 at 9:36 AM, Chris Travers
wrote:
> Hi all;
>
> There at least one request for the recorded talk. It is available at
> https://www.youtube.com/watch?v=8mKpfutwD0U
>
> The version to be delivered at Moscow will be slightly different in focus
> (but with
Any chance this will be recorded? The content looks great and would be of
interest to many.
Cheers
Seref
On Sat, Jan 21, 2017 at 8:55 AM, Chris Travers
wrote:
> Hi;
>
> I have been asked to deliver a seminar on use of PostgreSQL in large data
> environments. I have decided to send this to the
On Tue, Aug 4, 2015 at 9:06 AM, Chris Withers
wrote:
> On 03/08/2015 08:34, Seref Arikan wrote:
>
>>
>>
>> At what point does postgres stop scaling?
>> What happens when the computational load no longer fits on one
>> machine? What are the options
On Mon, Aug 3, 2015 at 8:22 AM, Chris Withers
wrote:
> On 03/08/2015 08:15, Jony Cohen wrote:
>
>> SSD disks are cheep these days but they don't like repeated
>> writes/deletes so it might cause problems down the line (hence my first RAM
>> recommendation)
>>
>> as for keeping the raw data - you
Postgres documentation is really excellent.
http://www.postgresql.org/docs/9.1/static/extend.html should get you
started.
On Mon, Mar 30, 2015 at 2:20 PM, Danushka Menikkumbura <
danushka.menikkumb...@gmail.com> wrote:
> Hi all,
>
> I am interesting in understanding the extensibility features a
Thanks Tom,
I'll give it a try, the whole setup is synthetic anyway, should not be too
much of a trouble
Best regards
Seref
On Sun, Mar 15, 2015 at 3:16 PM, Tom Lane wrote:
> Seref Arikan writes:
> > Another idea that popped into my head is to consider table partitioning.
>
ctions for research.
Best regards
Seref
On Sat, Mar 14, 2015 at 7:28 PM, Tom Lane wrote:
> Seref Arikan writes:
> > I have a table with 10s of millions of rows and I'm running a fairly
> > complex query with a lot of self joins.
>
> > This is an experimental db and
Greetings,
I have a table with 10s of millions of rows and I'm running a fairly
complex query with a lot of self joins.
This is an experimental db and the table structure needs to stay as it is.
I've noticed that some queries are not completed because postgres uses all
available space on disk for
Ah, I should have thought that it would be simple. Thanks a lot Vick.
Regards
Seref
On Fri, Feb 13, 2015 at 4:54 PM, Vick Khera wrote:
> On Fri, Feb 13, 2015 at 11:29 AM, Seref Arikan <
> serefari...@kurumsalteknoloji.com> wrote:
>
>> Hi Bill,
>> Could you poi
Thanks, google it is then ;)
On Fri, Feb 13, 2015 at 4:31 PM, Bill Moran
wrote:
> On Fri, 13 Feb 2015 16:29:02 +
> Seref Arikan wrote:
>
> > Hi Bill,
> > Could you point at some resource(s) that discuss inserting directly into
> > the partition?
>
> No
Hi Bill,
Could you point at some resource(s) that discuss inserting directly into
the partition? Would it be possible to read directly from the partition as
well?
Regards
Seref
On Fri, Feb 13, 2015 at 4:15 PM, Bill Moran
wrote:
> On Fri, 13 Feb 2015 11:12:13 -0500
> Vick Khera wrote:
>
> > On
Hi Jonathan,
I'm really interested in the type of hybrid architecture you've mentioned.
How is the read-only index constructed in the design you're mentioning?
It'd be much appreciated if you could briefly describe the order of
writes/reads given postgres and non-postgres components of the
architec
> for nested hstore, not jsonb, but you'll get the idea.
>
> On Wed, Sep 24, 2014 at 6:22 PM, Seref Arikan
> wrote:
>
>> This is interesting. Most binary encoding methods I use produce smaller
>> files than the text files for the same content.
>> Having read your m
This is interesting. Most binary encoding methods I use produce smaller
files than the text files for the same content.
Having read your mail, I've realized that I have no reason to accept the
same from the jsonb. I did a quick google search to see if it is wrong to
expect binary encoding to decrea
I've gone through the same journey myself. Tried to juggle dlls etc.
Apparently python 2 is no longer included in the windows installer.
Since I have lots of python 2.x code with native extensions etc, I thought
about compiling postgres from source on Windows but as usual the process
turned into a
Hi Jimmy,
I think you're going to need to perform experiments and decide if the
flexibility you get is worth the performance you're going to lose.
As you can see from John R Pierce's response it is only matter of time
before someone (correctly) warns you about the performance issues with EAV
deriva
François,
How vry stupid of me, and how kind of you to point at the obvious thing I
was missing.
Best regards
Seref
On Sun, Aug 10, 2014 at 12:40 PM, François Beausoleil
wrote:
>
> > Le 2014-08-10 à 06:31, Seref Arikan a écrit :
> >
> > Greetings,
> > A function a
Greetings,
A function aborts with the error in the subject line despite the available
free space on the disk.
I have a bunch of other questions regarding the underlying reason but first
things first: why is pg telling me no space is left on device when there is
space?
the only config param I can s
d for
performance reasons, though it leaves a bad taste in my mouth as well :(
Best regards
Seref
On Wed, Jul 30, 2014 at 7:54 PM, Tom Lane wrote:
> Seref Arikan writes:
> > I want to call a function using a column of a table as the parameter and
> > return the parameter and funct
Wed, Jul 30, 2014 at 7:26 PM, David G Johnston <
david.g.johns...@gmail.com> wrote:
> Seref Arikan wrote
> > select 1,test_empty_row(1);
>
> SELECT 1, (SELECT test_empty_row(1)) AS func_result
>
> You can also adjust the function to either return the result of the query
CT NULL, NULL LIMIT 1;
> $$
> world-# LANGUAGE sql;
> CREATE FUNCTION
> Time: 74.320 ms
> world=# SELECT * FROM xx(1);
> a | b
> ---+---
> 1 | 1
> (1 row)
>
> Time: 1.698 ms
> world=# SELECT * FROM xx(2);
> a | b
> ---+---
>|
> (1 row)
>
&
Greetings,
I want to call a function using a column of a table as the parameter and
return the parameter and function results together.
The problem is, when the function returns an empty row my select statement
that uses the function returns an empty row as well.
The following simplified snippet d
topic would be OK.
No worries if you can't think of a response, you've already helped ;)
Best regards
Seref
On Thu, Jul 24, 2014 at 6:43 PM, Tom Lane wrote:
> Seref Arikan writes:
> > The documentation for Cursors at
> > http://www.postgresql.org/docs/9.2/static/plpgsql
Greetings,
The documentation for Cursors at
http://www.postgresql.org/docs/9.2/static/plpgsql-cursors.html says that:
"Rather than executing a whole query at once, it is possible to set up a
*cursor* that encapsulates the query, and then read the query result a few
rows at a time. One reason for d
Sorry, I meant: "calling a stored procedure you'll write in postgres from
php"
On Thu, Jun 5, 2014 at 5:13 PM, Seref Arikan wrote:
> Hi Carlos,
> When you say procedures, do you mean calling a stored procedure you'll
> write from php? Or executing the individual
standing how to call
postgres from php.
Regards
Seref
On Thu, Jun 5, 2014 at 5:03 PM, Carlos Carcamo wrote:
> Thanks for answering...
> I'm using php with postgresql 9.1, I have never used procedures with php,
> I'm new with postgresql
>
>
> 2014-06-05 9:45 GMT-06:00 Ser
Hi Carlos,
Unless I'm missing something here, your queries are probably being called
from a programming language (java/c# etc) and your database access api
should support transactions. If you perform both operations under the same
db transaction and commit your transaction things should be fine. If
Just for the record, I've increased the data volume X10 and observed only
quite small performance drop: average time per inner function call
increased from 12.6 ms to 13.3 ms.
Regards
Seref
On Wed, May 21, 2014 at 5:19 PM, Seref Arikan <
serefari...@kurumsalteknoloji.com> wrote:
se pattern anymore, or the
operation is completing before that happens, will generate more data and
try again.
Regards
Seref
On Wed, May 21, 2014 at 4:52 PM, Tom Lane wrote:
> Seref Arikan writes:
> > What may be building up here? I suspect deleting all rows from the temp
>
ly to eliminate the main temp table in the outer query
as a suspect.
Regards
Seref
On Wed, May 21, 2014 at 4:52 PM, Tom Lane wrote:
> Seref Arikan writes:
> > What may be building up here? I suspect deleting all rows from the temp
> > tables is not really deleting them si
Greetings,
I have a function that loops over a set of ids, calls a function inside the
loop using the current id as the parameter, and adds the result of the
function call to a temp table.
When the loop terminates, the temp table has all the rows from the function
call(s) and it is returned.
I've
Greetings,
I have some large files (larger than a few gigs) that I need to keep on
this, and I'm using postgres to manage metadata about these files.
Postgres wiki covers all the basics of the topic here:
http://wiki.postgresql.org/wiki/BinaryFilesInDB#Storing_Meta_data_and_symbolic_link_in_the_da
Thanks for the confirmation Peter,
I guess I'll take a good look at the existing implementations.
All the best
Seref
On Fri, Aug 9, 2013 at 10:24 PM, Peter Eisentraut wrote:
> On 8/7/13 10:43 AM, Seref Arikan wrote:
> > When a pl/python based function is invoked, does it
On Thu, Aug 8, 2013 at 2:54 AM, Sergey Konoplev wrote:
> On Wed, Aug 7, 2013 at 7:43 AM, Seref Arikan
> wrote:
> > When a pl/python based function is invoked, does it keep a python runtime
> > running across calls to same function? That is, if I use connection
> pooling,
Greetings,
Somehow I have failed to find the appropriate keywords for successful
results for my question.
When a pl/python based function is invoked, does it keep a python runtime
running across calls to same function? That is, if I use connection
pooling, can I save on the python runtime initiali
Thanks Tom,
I am happy with a 10K feet level discussion of the approach, and your
response is just what I was looking for.
Regards
Seref
On Wed, May 8, 2013 at 3:05 PM, Tom Lane wrote:
> Seref Arikan writes:
> > I've just noticed that some parts of the autogenerated
Greetings,
I have a domain specific language implementation that ends up as sql after
an automatic transformation/code generation phase.
The complexity of the generated sql queries can be significant, with lots
of self joins and many other criteria injected into sql.
I've just noticed that some p
Hi Merlin,
So should I interpret this as: there is a potential gain from choosing
subqueries over with WITHs ?
On Tue, Feb 19, 2013 at 3:33 PM, Merlin Moncure wrote:
> On Tue, Feb 19, 2013 at 9:22 AM, Joe Van Dyk wrote:
> > On Tue, Feb 19, 2013 at 1:02 AM, Albe Laurenz
> > wrote:
> >>
> >> J
Hi Merlin,
My plan is exactly what you've suggested, sending bytea to an external
server. The networking library I'm using uses threads, and this is where I
am creating threads.
On Mon, Feb 18, 2013 at 3:56 PM, Merlin Moncure wrote:
> On Mon, Feb 18, 2013 at 5:10 AM, Seref Ar
Thanks,
You are right, it is not what I'm doing, I'm simply calling code that works
on the binary blob using multiple threads.
On Mon, Feb 18, 2013 at 3:02 PM, Bruce Momjian wrote:
> On Mon, Feb 18, 2013 at 02:51:13PM +, Seref Arikan wrote:
> > Thanks Bruce,
> > I
ian wrote:
> On Mon, Feb 18, 2013 at 11:10:51AM +, Seref Arikan wrote:
> > Greetings,
> > What would happen if I create multiple threads from within a postgresql
> > function written in C?
> > I have the opportunity to do parallel processing on binary data, and I
> n
Greetings,
What would happen if I create multiple threads from within a postgresql
function written in C?
I have the opportunity to do parallel processing on binary data, and I need
to create multiple threads to do that.
If I can ensure that all my threads complete their work before I exit my
funct
Apologies, I found the answer in the documentation:
http://www.postgresql.org/docs/9.0/static/functions-conditional.html says:
"If the ELSE clause is omitted and no condition is true, the result is
null."
Best regards
Seref
On Tue, Feb 12, 2013 at 10:39 AM, Seref Arikan
Greetings,
I want to use CASE WHEN to make sure that I don't try to call a function on
a row that does not exist. This is used within a WHERE statement as follows
(without the function call I've mentioned);
WHERE
CASE WHEN EXISTS(SELECT ATRNODE.featuremappingid from ELEMENT1,
ATRNODE where E
really not sure if there is any other mail list out there that
would respond to a technical question with such helpful input on a
Christmas day. Thanks guys, you rock!
On Tue, Dec 25, 2012 at 6:37 PM, Tom Lane wrote:
> Seref Arikan writes:
> > I have a plpython function that retur
ww.postgresql.org/docs/9.2/interactive/sql-selectinto.html
>
> David J.
>
>
> On Dec 25, 2012, at 10:20, Seref Arikan
> wrote:
>
> > Greetings,
> > I have a plpython function that returns a set of records. I loop over
> them to insert them into a temp table cr
Greetings,
I have a plpython function that returns a set of records. I loop over them
to insert them into a temp table created by another function.
I wanted to test
select into temp_eav_table (column) select a.column from tbl as a where
approach to see if it performs better than the loop. Howev
Tom,
Thanks a lot! For some reason, I was under the impression that contrib
would include python. the --with-python switch did the trick.
Best regards
Seref
On Mon, Dec 24, 2012 at 9:35 PM, Tom Lane wrote:
> Seref Arikan writes:
> > After building postgresql from the git reposit
Greetings,
After building postgresql from the git repository, I've tried to create a
db that I have, and I've faced the exact same problem described here:
http://archives.postgresql.org/pgsql-general/2012-02/msg00753.php
Basically, the extension directory does not contain plpythonu.control. I've
bu
Thanks Merlin,
I'll take a better look at CTE.
Best regards
Seref
On Tue, Nov 27, 2012 at 4:48 PM, Merlin Moncure wrote:
> On Tue, Nov 27, 2012 at 10:06 AM, Seref Arikan
> wrote:
> > I have a function that creates a temp table, inserts rows into it,
> performs
> > j
Moncure wrote:
> On Tue, Nov 27, 2012 at 9:44 AM, Seref Arikan
> wrote:
> >> > Also I need those tables per session, so creating and dropping with
> TEMP
> >> > tables appear to be faster.
> >>
> >> Performance of creating tables is going
Hi Merlin,
See below please
On Tue, Nov 27, 2012 at 3:29 PM, Merlin Moncure wrote:
> On Fri, Nov 23, 2012 at 4:09 AM, Peter Kroon wrote:
> > I've put up a small test case for creating TEMP and UNLOGGED tables.
> > DROP TABLE IF EXISTS test CASCADE;
> > CREATE TEMP TABLE test(
> > id serial,
> >
Fantastic resource. Thanks for this!
On Tue, Oct 30, 2012 at 3:16 PM, Adrian Klaver wrote:
> On 10/30/2012 04:07 AM, RAJDEEP SARDAR wrote:
>
>> Dear All,
>>
>> I am a Mtech Student,IIT Bombay,India.
>>
>> I am having a database course project where I need to make some
>> modification in postgresq
Thanks for the clarification Craig.
On Mon, Oct 29, 2012 at 8:46 AM, Craig Ringer wrote:
> On 10/29/2012 04:07 PM, Seref Arikan wrote:
> > Greetings,
> > I keep seeing statements like "Postgresql optimizer rewrites this query
> > as" What I'm curious ab
Greetings,
I keep seeing statements like "Postgresql optimizer rewrites this query
as" What I'm curious about is, is there a way to obtain SQL form of the
re-written queries somewhere in the chain of query evaluation? It does not
make a lot sense to generate sql again, but it would help a lot t
thers asking the same question, surely
someone must have properly established this under *nix. I'll keep
searching, and post my solution for feedback.
Kind regards
Seref
On Sun, Oct 14, 2012 at 5:54 AM, Jasen Betts wrote:
> On 2012-10-10, Seref Arikan wrote:
> > --f46d04430
Stern <
bret_st...@machinemanagement.com> wrote:
> create a ramdrive
> On Wed, 2012-10-10 at 14:27 +0100, Seref Arikan wrote:
> > Hi Merlin,
> > Thanks for the response. At the moment, the main function is creating
> > two temp tables that drops on commit, and python functions fills
>
Comments inline (sorry, did not cc the group in the other mail)
On Wed, Oct 10, 2012 at 2:55 PM, Merlin Moncure wrote:
> On Wed, Oct 10, 2012 at 8:27 AM, Seref Arikan
> wrote:
> > Hi Merlin,
> > Thanks for the response. At the moment, the main function is creating two
&g
m the expensive transformations once and reuse the
results.
Kind regards
Seref
On Wed, Oct 10, 2012 at 2:06 PM, Merlin Moncure wrote:
> On Mon, Oct 8, 2012 at 4:59 PM, Seref Arikan
> wrote:
> > Thanks Merlin,
> > I've tried arrays but plpython does not support returning arr
Thanks Merlin,
I've tried arrays but plpython does not support returning arrays of custom
db types (which is what I'd need to do)
On Monday, 8 October 2012, Merlin Moncure wrote:
> On Mon, Oct 8, 2012 at 3:14 PM, Seref Arikan
> > wrote:
> > Greetings,
> > I have a
Greetings,
I have a binary blog which is passed to a plpython function by a plpgsql
function. plpython is used to create 2 different transformations of this
binary blob to sets of postgresql type instances.
The flow is: blob -> plpython -> canonical python based data model ->
(set of db_type_As +
Thanks Aleksey,
Definitely worth noting. Impressive scalability according to slides. The
use of Java is particularly interesting to me.
Best regards
Seref
On Wed, Sep 5, 2012 at 6:27 AM, Aleksey Tsalolikhin wrote:
> Hi, Seref. You might want to take a look at Stado:
> http://www.slideshare.ne
ng it in the rubbish
bin, but the performance penalty is simply too big.
Best regards
Seref
On Thu, Aug 30, 2012 at 8:09 PM, David Johnston wrote:
> From: pgsql-general-ow...@postgresql.org
> [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Seref Arikan
> Sent: Thursday, Augu
Greetings,
I have a large number of rows (up to 3-4 millions) that I'll either be
fetching into ram (if it is a few thousand rows), or scrolling through a
cursor.
Deletions or updates on content of these rows lead to expensive operations
in my business logic, so I simply need to mark them as disabl
On Tue, Aug 28, 2012 at 2:14 PM, Craig Ringer wrote:
> On 08/28/2012 08:56 PM, Seref Arikan wrote:
>
>> Can I simply adopt the naive approach of updating an EHR metadata table
>> within a transaction in every partition addition/deletion operation?
>>
>
> Absolutely.
Greetings,
I need to keep various information related to a parent entity (the
Electronic Health Record for a single patient) and its children (partitions
of the EHR, since it can get very big).
It is important that I know how many partitions exist for an EHR, and I'd
like to avoid a query that'll c
rom my PhD efforts. I'll certainly add the option of funding some
key work into those discussions, which actually fits the model that we've
been discussing at the university for some time very well.
Kind regards
Seref
On Wed, Aug 22, 2012 at 4:24 AM, Craig Ringer wrote:
> On 08/
Dear all,
I am designing an electronic health record repository which uses postgresql
as its RDMS technology. For those who may find the topic interesting, the
EHR standard I specialize in is openEHR: http://www.openehr.org/
My design makes use of parallel execution in the layers above DB, and it
would scale in terms of
performance to a few billion rows.
Best regards
Seref
On Wed, Aug 8, 2012 at 3:45 PM, David Johnston wrote:
> From: pgsql-general-ow...@postgresql.org
> [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Seref Arikan
> Sent: Wednesday, August 08, 2012 10:
Greetings,
I've been trying to use contains operator on an array such as {3,4,9,4,5}
My problem is, I'd like to get rows that has two 4s in them, and contains
operator seems to work separately for each member of the right operand.
Therefore
select '{3,4,9,4,5}'::int[] @> '{4,4,4}'
returns true.
I think simple requirements would fit reporting tools space better.
Another alternative worth looking into may be Eclipse BIRT
On 26 Jul 2012, at 13:18, Chris Curvey wrote:
> On Wed, Jul 25, 2012 at 1:41 PM, Mark Phillips
> wrote:
>> I am seeking suggestions for business intelligence and da
Hi Mark,
For me, Pentaho has delivered quite good results in the past, and being an
open source offering it would probably work OK with postgresql. Jasper
reports also seems to have made it into BI space, and I would assume it'd
work with postgresql too or so I recall. Both are open source
project
mance
of the options.
Kind regards
Seref
On Fri, May 18, 2012 at 10:55 AM, Marti Raudsepp wrote:
> On Thu, May 17, 2012 at 8:40 PM, Seref Arikan
> wrote:
> > Is there a glaring error in my approach? Should I be better off with
> another
> > SQL query, or Ltree/XPATH queries?
&
Trying to reply to Rob:
Apologies if this does not end up in the thread (gmail is just driving me
mad, I can't seem to receive messages, so I've subscribed again)
For some reason Limit 1 cause my query to go on for minutes without a
response, which was not the case.
The following query takes abo
I have a key value table in my Postgresql db, which represents hierarchical
data through parent_feature_mapping column that points to id of
feature_mapping_id column of the same table.
I need to select root nodes that has children which satisfy various
conditions. The conditions may extend to chil
anges.
Eliminating the loop made all the difference.
Next thing to check out is the partitioning options.
Kind regards.
2009/4/23 Filip Rembiałkowski
>
> W dniu 22 kwietnia 2009 23:47 użytkownik Seref Arikan <
> serefari...@kurumsalteknoloji.com> napisał:
>
>> Hi Filip,
n, to make the total framework faster. Therefore,
all suggestions are welcommed.
All the best
Seref
On Thu, Apr 23, 2009 at 1:21 AM, Scott Marlowe wrote:
> 2009/4/22 Seref Arikan :
> > Hi Filip,
> > First of all: thanks a lot for your kind response. Here is the create
&
Hi there,
I have a set of dynamically composed objects represented in Java, with
string values for various attributes, which have variable length. In case
you have suggestions for a better type for this case, it would be my
pleasure to hear about them.
2009/4/22 Grzegorz Jaśkiewicz
> you keep ev
Hi Filip,
First of all: thanks a lot for your kind response. Here is the create script
for my schema:
CREATE TABLE "app"."archetype_data" (
"id" BIGINT NOT NULL,
"context_id" VARCHAR(1000),
"archetype_name" VARCHAR(1000),
"archetype_path" VARCHAR(1000),
"name" VARCHAR(1000),
"value_str
79 matches
Mail list logo
