Re: Oracle_FDW table performance issue

2022-07-11 Thread aditya desai
Understood thanks!! Will try to build dynamiq query to send ids
across instead of join.

On Mon, Jul 11, 2022 at 8:56 PM Laurenz Albe 
wrote:

> On Mon, 2022-07-11 at 17:38 +0530, aditya desai wrote:
> > I have one Oracle fdw table which is giving performance issue when joined
> > local temp table gives performance issue.
> >
> > select * from oracle_fdw_table where transaction_id in ( select
> transaction_id from temp_table)
> >   54 seconds. Seeing HASH SEMI JOIN  in EXPLAIN PLAN. temp_table has
> only 74 records.
> >
> > select * from from oracle_fdw_table where transaction_id in (
> 1,2,3,.,75)--- 23ms.
> >
> > Could you please help me understand this drastic behaviour change?
>
> The first query joins a local table with a remote Oracle table.  The only
> way for
> such a join to avoid fetching the whole Oracle table would be to have the
> foreign scan
> on the inner side of a nested loop join.  But that would incur many round
> trips to Oracle
> and is therefore perhaps not a great plan either.
>
> In the second case, the whole IN list is shipped to the remote side.
>
> In short, the queries are quite different, and I don't think it is
> possible to get
> the first query to perform as well as the second.
>
> Yours,
> Laurenz Albe
> --
> Cybertec | https://www.cybertec-postgresql.com
>


Re: Oracle_FDW table performance issue

2022-07-11 Thread Laurenz Albe
On Mon, 2022-07-11 at 17:38 +0530, aditya desai wrote:
> I have one Oracle fdw table which is giving performance issue when joined
> local temp table gives performance issue.
> 
> select * from oracle_fdw_table where transaction_id in ( select 
> transaction_id from temp_table)
>   54 seconds. Seeing HASH SEMI JOIN  in EXPLAIN PLAN. temp_table has only 
> 74 records.
> 
> select * from from oracle_fdw_table where transaction_id in ( 
> 1,2,3,.,75)--- 23ms.
> 
> Could you please help me understand this drastic behaviour change?

The first query joins a local table with a remote Oracle table.  The only way 
for
such a join to avoid fetching the whole Oracle table would be to have the 
foreign scan
on the inner side of a nested loop join.  But that would incur many round trips 
to Oracle
and is therefore perhaps not a great plan either.

In the second case, the whole IN list is shipped to the remote side.

In short, the queries are quite different, and I don't think it is possible to 
get
the first query to perform as well as the second.

Yours,
Laurenz Albe
-- 
Cybertec | https://www.cybertec-postgresql.com




Re: Oracle_FDW table performance issue

2022-07-11 Thread aditya desai
Hi Justin,
Sorry unable to send a query plan from a closed network. Here the stats are
updated on the Oracle table.


It seems like when joining the local tables it is not filtering data on
Oracle and bringing data to postgres. It is filtering when we actually pass
the values.


Regards,
Aditya.

On Mon, Jul 11, 2022 at 5:43 PM Justin Pryzby  wrote:

> On Mon, Jul 11, 2022 at 05:38:34PM +0530, aditya desai wrote:
> > Hi,
> > I have one Oracle fdw table which is giving performance issue when joined
> > local temp table gives performance issue.
> >
> > select * from oracle_fdw_table where transaction_id in ( select
> > transaction_id from temp_table)  54 seconds. Seeing HASH SEMI JOIN
> in
> > EXPLAIN PLAN. temp_table has only 74 records.
>
> You'd have to share the plan
>
> https://wiki.postgresql.org/wiki/Slow_Query_Questions
>
> Do the tables have updated stats ?
>


Re: Oracle_FDW table performance issue

2022-07-11 Thread Justin Pryzby
On Mon, Jul 11, 2022 at 05:38:34PM +0530, aditya desai wrote:
> Hi,
> I have one Oracle fdw table which is giving performance issue when joined
> local temp table gives performance issue.
> 
> select * from oracle_fdw_table where transaction_id in ( select
> transaction_id from temp_table)  54 seconds. Seeing HASH SEMI JOIN  in
> EXPLAIN PLAN. temp_table has only 74 records.

You'd have to share the plan

https://wiki.postgresql.org/wiki/Slow_Query_Questions

Do the tables have updated stats ?




Oracle_FDW table performance issue

2022-07-11 Thread aditya desai
Hi,
I have one Oracle fdw table which is giving performance issue when joined
local temp table gives performance issue.

select * from oracle_fdw_table where transaction_id in ( select
transaction_id from temp_table)  54 seconds. Seeing HASH SEMI JOIN  in
EXPLAIN PLAN. temp_table has only 74 records.


select * from from oracle_fdw_table where transaction_id in (
1,2,3,.,75)--- 23ms.


Could you please help me understand this drastic behaviour change?

Regards,
Aditya.