I tried something from this website: http://saifulmuhajir.web.id/postgresql-amazon-rds-as-a- master-how-to-replicate-from-aws/
which is to set quick_delta_check=1 after doing that, i started bucardo and it started with no errors but replication was not working unless i do: bucardo update sync <name> onetimecopy=1 and then start bucardo but any DMLs after that will not work unless i restart bucardo here is my bucardo DBs, relgroups and sync: [cayodele@ip-1xx-x-x-xx bucardo-master]$ bucardo list dbs Database: auth93 Status: active Conn: psql -p 5432 -U ticadmin -d auth -h xx-xx.xxxxx.us-east-1.rds.amazonaws.com Database: auth96 Status: active Conn: psql -p 5432 -U ticadmin -d auth -h xx.xxxxx.us-east-1.rds.amazonaws.com [cayodele@ip-1xx-x-x-xx bucardo-master]$ bucardo list relgroup Relgroup: rel_auth93 DB: auth93 Members: public.actions, public.actions_id_seq, public.activation_token, public.activation_token_id_seq, public.customer_servers, public.customer_servers_id_seq, public.permissions, public.permissions_id_seq, public.resources, public.resources_id_seq, public.role_permission, public.role_permission_id_seq, public.roles, public.roles_id_seq, public.user_api_key, public.user_api_key_id_seq, public.user_credentials, public.user_credentials_id_seq, public.user_permission, public.user_permission_id_seq, public.user_role, public.user_role_id_seq, public.users, public.users_id_seq Used in syncs: auth_sync [cayodele@ip-1xx-x-x-xx bucardo-master]$ bucardo list sync Sync "auth_sync" Relgroup "rel_auth93" DB group "auth_sync" auth93:source auth96:target [Active] On Mon, Jan 15, 2018 at 3:06 PM, caleb ayodele <[email protected]> wrote: > Bucardo Inernal log: > -------------------------- > > (17427) [Mon Jan 15 20:03:49 2018] KID (auth_sync) New kid, sync > "auth_sync" alive=1 Parent=17424 PID=17427 kicked=1 > (17427) [Mon Jan 15 20:04:08 2018] KID (auth_sync) Kid has died, error is: > DBD::Pg::st execute failed: ERROR: query string argument of EXECUTE is > null CONTEXT: PL/pgSQL function bucardo.bucardo_delta_check(text,text) > line 24 at EXECUTE statement at /usr/local/share/perl5/Bucardo.pm line > 3407. Line: 5037 Main DB state: ? Error: none DB auth93 state: 22004 Error: > 7 DB auth96 state: ? Error: none > (17427) [Mon Jan 15 20:04:08 2018] KID (auth_sync) Kid 17427 exiting at > cleanup_kid. Sync "auth_sync" public.activation_token_id_seq Reason: > DBD::Pg::st execute failed: ERROR: query string argument of EXECUTE is > null CONTEXT: PL/pgSQL function bucardo.bucardo_delta_check(text,text) > line 24 at EXECUTE statement at /usr/local/share/perl5/Bucardo.pm line > 3407. Line: 5037 Main DB state: ? Error: none DB auth93 state: 22004 Error: > 7 DB auth96 state: ? Error: none > (17419) [Mon Jan 15 20:04:09 2018] MCP Starting check_sync_health > > > RDS log: > -------------- > 2018-01-15 20:02:58 UTC::[unknown]@[unknown]:[28222]:WARNING: > pg_getnameinfo_all() failed: Temporary failure in name resolution > 2018-01-15 20:03:18 UTC::[unknown]@[unknown]:[28420]:WARNING: > pg_getnameinfo_all() failed: Temporary failure in name resolution > 2018-01-15 20:03:38 UTC::[unknown]@[unknown]:[28632]:WARNING: > pg_getnameinfo_all() failed: Temporary failure in name resolution > 2018-01-15 20:03:38 UTC::[unknown]@[unknown]:[28633]:WARNING: > pg_getnameinfo_all() failed: Temporary failure in name resolution > 2018-01-15 20:03:58 UTC::[unknown]@[unknown]:[28870]:WARNING: > pg_getnameinfo_all() failed: Temporary failure in name resolution > 2018-01-15 20:04:08 UTC:???(???):ticadmin@auth:[28870]:ERROR: query > string argument of EXECUTE is null > 2018-01-15 20:04:08 UTC:???(???):ticadmin@auth:[28870]:CONTEXT: PL/pgSQL > function bucardo.bucardo_delta_check(text,text) line 24 at EXECUTE > statement > 2018-01-15 20:04:08 UTC:???(???):ticadmin@auth:[28870]:STATEMENT: SELECT > * FROM bucardo.bucardo_delta_check($1,$2) > 2018-01-15 20:04:19 UTC::[unknown]@[unknown]:[29068]:WARNING: > pg_getnameinfo_all() failed: Temporary failure in name resolution > 2018-01-15 20:04:29 UTC:???(???):ticadmin@auth:[29068]:ERROR: query > string argument of EXECUTE is null > 2018-01-15 20:04:29 UTC:???(???):ticadmin@auth:[29068]:CONTEXT: PL/pgSQL > function bucardo.bucardo_delta_check(text,text) line 24 at EXECUTE > statement > 2018-01-15 20:04:29 UTC:???(???):ticadmin@auth:[29068]:STATEMENT: SELECT > * FROM bucardo.bucardo_delta_check($1,$2) > 2018-01-15 20:04:39 UTC::[unknown]@[unknown]:[29345]:WARNING: > pg_getnameinfo_all() failed: Temporary failure in name resolution > 2018-01-15 20:04:45 UTC::@:[3236]:LOG: checkpoint starting: time > 2018-01-15 20:04:46 UTC::@:[3236]:LOG: checkpoint complete: wrote 4 > buffers (0.0%); 0 transaction log file(s) added, 0 removed, 1 recycled; > write=0.305 s, sync=0.013 s, total=0.338 s; sync files=4, longest=0.013 s, > average=0.003 s > 2018-01-15 20:04:49 UTC:???(???):ticadmin@auth:[29345]:ERROR: query > string argument of EXECUTE is null > 2018-01-15 20:04:49 UTC:???(???):ticadmin@auth:[29345]:CONTEXT: PL/pgSQL > function bucardo.bucardo_delta_check(text,text) line 24 at EXECUTE > statement > > On Mon, Jan 15, 2018 at 2:50 PM, David Christensen <[email protected]> > wrote: > >> So what were the first errors seen (both on RDS and Bucardo’s internal >> logs)? >> >> Best, >> >> David >> >> >> On Jan 15, 2018, at 1:29 PM, caleb ayodele <[email protected]> wrote: >> >> i also saw this is logs of the source RDS database instance: >> >> 2018-01-15 18:52:12 UTC:???(???):ticadmin@auth:[12826]:ERROR: query >> string argument of EXECUTE is null >> 2018-01-15 18:52:12 UTC:???(???):ticadmin@auth:[12826]:CONTEXT: PL/pgSQL >> function bucardo.bucardo_delta_check(text,text) line 24 at EXECUTE >> statement >> 2018-01-15 18:52:12 UTC:???(???):ticadmin@auth:[12826]:STATEMENT: SELECT >> * FROM bucardo.bucardo_delta_check($1,$2) >> 2018-01-15 18:52:23 UTC::[unknown]@[unknown]:[13046]:WARNING: >> pg_getnameinfo_all() failed: Temporary failure in name resolution >> 2018-01-15 18:52:33 UTC:???(???):ticadmin@auth:[13046]:ERROR: query >> string argument of EXECUTE is null >> 2018-01-15 18:52:33 UTC:???(???):ticadmin@auth:[13046]:CONTEXT: PL/pgSQL >> function bucardo.bucardo_delta_check(text >> >> On Mon, Jan 15, 2018 at 12:17 PM, caleb ayodele <[email protected]> wrote: >> >>> i installed burcado on a separated EC2 instance with postgres9.6 >>> >>> i created a bucardo database in the postgres instance >>> >>> the bucardo install created a bucardo user and created several tables >>> >>> i dumped the source database into the target >>> >>> i created the source/target database with bucardo and also create a herd >>> >>> i added all the tables and sequences to the herd >>> >>> i created a sync and started bucardo >>> >>> >>> This is what i saw in the logs: >>> >>> 24176) [Sun Jan 14 21:37:38 2018] KID (auth_migrate) Kid has died, error >>> is: DBD::Pg::st execute failed: ERROR: query string argument of EXECUTE is >>> null CONTEXT: PL/pgSQL function bucardo.bucardo_delta_check(text,text) >>> line 24 at EXECUTE statement at /usr/local/share/perl5/Bucardo.pm line >>> 3400. Line: 5041 Main DB state: ? Error: none DB auth93 state: 22004 Error: >>> 7 DB auth96 state: ? Error: none >>> (24176) [Sun Jan 14 21:37:38 2018] KID (auth_migrate) Kid 24176 exiting >>> at cleanup_kid. Sync "auth_migrate" public.activation_token_id_seq Reason: >>> DBD::Pg::st execute failed: ERROR: query string argument of EXECUTE is >>> null CONTEXT: PL/pgSQL function bucardo.bucardo_delta_check(text,text) >>> line 24 at EXECUTE statement at /usr/local/share/perl5/Bucardo.pm line >>> 3400. Line: 5041 Main DB state: ? Error: none DB auth93 state: 22004 Error: >>> 7 DB auth96 state: ? Error: none >>> (24150) [Sun Jan 14 21:37:38 2018] MCP Starting check_sync_health >>> (24179) [Sun Jan 14 21:37:49 2018] KID (auth_migrate) New kid, sync >>> "auth_migrate" alive=1 Parent=24154 PID=24179 kicked=1 >>> (24179) [Sun Jan 14 21:37:50 2018] KID (auth_migrate) Kid has died, >>> error is: DBD::Pg::st execute failed: ERROR: query string argument of >>> EXECUTE is null CONTEXT: PL/pgSQL function >>> bucardo.bucardo_delta_check(text,text) >>> line 24 at EXECUTE statement at /usr/local/share/perl5/Bucardo.pm line >>> 3400. Line: 5041 Main DB state: ? Error: none DB auth93 state: 22004 Error: >>> 7 DB auth96 state: ? Error: none >>> (24179) [Sun Jan 14 21:37:50 2018] KID (auth_migrate) Kid 24179 exiting >>> at cleanup_kid. Sync "auth_migrate" public.activation_token_id_seq Reason: >>> DBD::Pg::st execute failed: ERROR: query string argument of EXECUTE is >>> null CONTEXT: PL/pgSQL function bucardo.bucardo_delta_check(text,text) >>> line 24 at EXECUTE statement at /usr/local/share/perl5/Bucardo.pm line >>> 3400. Line: 5041 Main DB state: ? Error: none DB auth93 state: 22004 Error: >>> 7 DB auth96 state: ? Error: none >>> >>> >>> I think it might have something to do with a fucntion called >>> *bucardo_delta_check(text,text)* but i looked for the function in the >>> database and couldn't find it. >>> >>> On Mon, Jan 15, 2018 at 11:32 AM, caleb ayodele <[email protected]> >>> wrote: >>> >>>> Hi David, >>>> >>>> >>>> I followed the instructions from the below websites. >>>> >>>> http://saifulmuhajir.web.id/postgresql-amazon-rds-as-a-maste >>>> r-how-to-replicate-from-aws/ >>>> >>>> https://www.endpoint.com/blog/2017/06/06/amazon-aws-upgrades >>>> -to-postgres-with >>>> >>>> https://bucardo.org/Bucardo/Installation/ >>>> >>>> On Mon, Jan 15, 2018 at 11:14 AM, David Christensen <[email protected] >>>> > wrote: >>>> >>>>> Hi Caleb, >>>>> >>>>> Can you provide the steps you used to setup/install? >>>>> >>>>> Best, >>>>> >>>>> David >>>>> >>>>> >>>>> On Jan 14, 2018, at 2:28 PM, caleb ayodele <[email protected]> wrote: >>>>> >>>>> Thanks for the quick response. i was able to use your documentation on >>>>> the installation and was able to start bucardo but i ran into some issues. >>>>> >>>>> *issue #1* >>>>> >>>>> i got this error: >>>>> *Last error: : Failed : DBD::Pg::st execute failed: >>>>> ERROR: query string argument of EXECUTE is null CONTEXT: PL/pgSQL >>>>> function bucardo.bucardo_delta_check(text,text) line 24 at EXECUTE >>>>> statement at /usr/local/share/perl5/Bucardo.pm line 3400. Line: 5041 Main >>>>> DB state: ? Error: none DB auth93 state: 22004 Error: 7 DB auth96 state: ? >>>>> Error: none (KID 23032)* >>>>> >>>>> *issue #2* >>>>> >>>>> Bucardo is not replicating to the target >>>>> >>>>> On Sat, Jan 13, 2018 at 7:37 PM, Saiful Muhajir < >>>>> [email protected]> wrote: >>>>> >>>>>> The steps is quite straightforward as documented. The only difference >>>>>> is that you need a standalone bucardo server where you would install >>>>>> Postgres with ability to install bucardo, such as EC2 instances. >>>>>> >>>>>> Once bucardo server is ready, add the source and target RDS servers >>>>>> and continue from there as the documents said. >>>>>> >>>>>> To summarized: >>>>>> - prepare an EC2 instances to install bucardo >>>>>> - add both source and target in bucardo server >>>>>> - add tables, relgroups, syncs, and start >>>>>> >>>>>> >>>>>> On 13 Jan 2018 7:00 pm, <[email protected]> wrote: >>>>>> >>>>>> Send Bucardo-general mailing list submissions to >>>>>> [email protected] >>>>>> >>>>>> To subscribe or unsubscribe via the World Wide Web, visit >>>>>> https://mail.endcrypt.com/mailman/listinfo/bucardo-general >>>>>> or, via email, send a message with subject or body 'help' to >>>>>> [email protected] >>>>>> >>>>>> You can reach the person managing the list at >>>>>> [email protected] >>>>>> >>>>>> When replying, please edit your Subject line so it is more specific >>>>>> than "Re: Contents of Bucardo-general digest..." >>>>>> >>>>>> >>>>>> Today's Topics: >>>>>> >>>>>> 1. Install Bucardo on Amazon RDS PostgreSQL (caleb ayodele) >>>>>> >>>>>> >>>>>> ------------------------------------------------------------ >>>>>> ---------- >>>>>> >>>>>> Message: 1 >>>>>> Date: Sat, 13 Jan 2018 01:01:54 -0500 >>>>>> From: caleb ayodele <[email protected]> >>>>>> To: [email protected] >>>>>> Subject: [Bucardo-general] Install Bucardo on Amazon RDS PostgreSQL >>>>>> Message-ID: <[email protected]> >>>>>> Content-Type: text/plain; charset=utf-8 >>>>>> >>>>>> I want to do a migration from RDS Postgres 9.3 to 9.6 with little >>>>>> down time and I was wondering if it is possible for Bucardo to work on >>>>>> RDS >>>>>> Postgres. If so, please let me know how to install it because I can?t >>>>>> seem >>>>>> to get around the plperlu extension part. >>>>>> >>>>>> ------------------------------ >>>>>> >>>>>> _______________________________________________ >>>>>> Bucardo-general mailing list >>>>>> [email protected] >>>>>> https://mail.endcrypt.com/mailman/listinfo/bucardo-general >>>>>> >>>>>> >>>>>> End of Bucardo-general Digest, Vol 120, Issue 3 >>>>>> *********************************************** >>>>>> >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Bucardo-general mailing list >>>>>> [email protected] >>>>>> https://mail.endcrypt.com/mailman/listinfo/bucardo-general >>>>>> >>>>>> >>>>> _______________________________________________ >>>>> Bucardo-general mailing list >>>>> [email protected] >>>>> https://mail.endcrypt.com/mailman/listinfo/bucardo-general >>>>> >>>>> >>>>> -- >>>>> David Christensen >>>>> End Point Corporation >>>>> [email protected] >>>>> 785-727-1171 <(785)%20727-1171> >>>>> >>>>> >>>>> >>>>> >>>> >>> >> >> -- >> David Christensen >> End Point Corporation >> [email protected] >> 785-727-1171 <(785)%20727-1171> >> >> >> >> >
_______________________________________________ Bucardo-general mailing list [email protected] https://mail.endcrypt.com/mailman/listinfo/bucardo-general
