Re: [Bucardo-general] empty integer values

2021-08-11 Thread Greg Sabino Mullane
Column 2 cannot have an empty string if it is truly a bigint - can you share the DDL (i.e. CREATE TABLE statement) for that table? Bucardo should have no problem with bigint columns. Could be some sort of edge case but seeing the exact table could help us narrow things down. Cheers, Greg

Re: [Bucardo-general] resolving exceptions by picking both rows

2021-05-15 Thread Greg Sabino Mullane
Just saw this again: I don't think we have anything that can quite handle this case. Since you asked Bucardo to re-do the sync, but the PKs have changed, it is going to delete all the affected PKs and then re-add them. But it cannot re-add the same ones, as the custom code has modified them.

Re: [Bucardo-general] Possible areas for Bucardo modernization

2020-11-30 Thread Greg Sabino Mullane
major version is to remove the plperl dependency. I had a branch and got about 75% of the way there at one point, but it's probably too stale to worry about now. I seem to recall it wasn't too hard, as most of the logic can be handled directly by the 'bucardo' script. - -- Greg Sab

Re: [Bucardo-general] Bucardo install fails

2017-11-29 Thread Greg Sabino Mullane
n ## Assign the version variables -my ($maj,$min,$rev) = ($1,$2,$3); -## We need to be able to handle things such as 9.2devel -$rev =~ s/^\.//; -$rev =~ s/(\d+)\.\d+/$1/; +my ($maj,$min) = ($1,$2); $QUIET or print "Postgres version is: $maj.$min\n";

Re: [Bucardo-general] Bucardo install fails

2017-11-29 Thread Greg Sabino Mullane
nt to fix it, but it did help me identify the problem. A fix should be arriving soon. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP signature __

Re: [Bucardo-general] Bucardo install fails

2017-11-28 Thread Greg Sabino Mullane
t look for this line: $QUIET or print "Postgres version is: $maj.$min\n"; and change it to: $QUIET or print "Postgres version is: $maj.$min ($res)\n"; -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 sign

Re: [Bucardo-general] Bucardo add tables fails in postgres 10

2017-11-27 Thread Greg Sabino Mullane
the pkey fields get populated. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP signature ___ Bucardo-general mailing list Bucardo-genera

Re: [Bucardo-general] Bucardo sync Error

2017-11-14 Thread Greg Sabino Mullane
On Tue, Nov 14, 2017 at 03:08:37PM +, Rohit Suraj Kapoor wrote: > Thanks Greg, I was able to resolve this issue with altering tcp keepalive > parameters. Great, good to know. Can you share what you adjusted them to for the benefits of the archives? -- Greg Sabino Mullane g...@endpoi

Re: [Bucardo-general] Bucardo sync Error

2017-11-13 Thread Greg Sabino Mullane
o's statement_chunk_size to 1000), more memory on the server, or perhaps decreasing work_mem or other schemes to reduce the overall memory usage. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description:

Re: [Bucardo-general] Design of new txntime field

2017-09-11 Thread Greg Sabino Mullane
txntime field now for any reason. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP signature ___ Bucardo-general mailing list Bucardo-general@buca

Re: [Bucardo-general] Design of new txntime field

2017-09-07 Thread Greg Sabino Mullane
y to upgrade existing installations - the timestamp and timestamp+txid can coexist peacefully -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP signature __

Re: [Bucardo-general] Design of new txntime field

2017-09-07 Thread Greg Sabino Mullane
ent, which basically adds some precision to the timestamp, e.g. now() || txid_current()::text This means we have to store it as a text, and not a timestamp field, but it still sorts, and we don't do any other time-based queries on the field, other than the vac process, but that can be chang

Re: [Bucardo-general] INSTALLATION ERROR

2017-07-19 Thread Greg Sabino Mullane
On Wed, Jul 19, 2017 at 05:49:00AM +, Om Prakash Jaiswal wrote: > Thanks Sir.Now I installed Bucardo-5.4.1 successfully with PostgreSQL 9.4.8 > 64bit RHEL 7 OS. > is this version will also work with PostgreSQL 9.6.xxx ? Yes, that will be fine. -- Greg Sabino Mullane g...@endpoin

Re: [Bucardo-general] INSTALLATION ERROR

2017-07-18 Thread Greg Sabino Mullane
uperuser" role enabled. From the psql prompt, \du will show you a list of all users and their roles. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description:

Re: [Bucardo-general] Adding a database with failed connection

2017-06-23 Thread Greg Sabino Mullane
e to get everything setup, then change the bucardo.db table to point to the real one when it is up and running. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP signature

Re: [Bucardo-general] Adding a database with failed connection

2017-06-23 Thread Greg Sabino Mullane
o bucardo [local] COMMIT waiting for 0/F04F938 That's unusual as well. Are you seeing that anywhere else? You could also try setting a timeout to help with the debug: $ export PGCONNECT_TIMEOUT=10 -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944

Re: [Bucardo-general] Bucardo 5: conflict logging and resolution strategies

2017-06-23 Thread Greg Sabino Mullane
ally supported is bucardo_latest - the other ones used in Bucardo 4 do not make sense any more, as we can have any number of sources or targets. Thanks for your patience. Questions and complaints on the mailing list are a great way of gauging what parts of Bucardo need to be worked on next! :) -- Gr

Re: [Bucardo-general] bucardo installation problem

2017-06-23 Thread Greg Sabino Mullane
is the place you installed bucardo. Also try a command line invocation to view the config contents: bucardo show all -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Descriptio

Re: [Bucardo-general] Bucardo add sync failed

2017-06-14 Thread Greg Sabino Mullane
On Fri, Jun 09, 2017 at 02:42:50PM +0800, 张远 wrote: > what is "a standalone session" , connect db with a different ip ? It means connect to the database yourself (for example, with the "psql" program) and run the SQL manually. -- Greg Sabino Mullane g...@endpoint.co

Re: [Bucardo-general] we want make sync more than database each one database in different server

2017-06-14 Thread Greg Sabino Mullane
r each database to e replicated. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP signature ___ Bucardo-general mailing list Bucardo-general@bucar

Re: [Bucardo-general] run "bucardo show all " error

2017-06-14 Thread Greg Sabino Mullane
e 308. > """ Make sure the .pgpass file has an entry for the bucardo user, connecting to the database shown in the error. The line should look like this: localhost:5432:bucardo:bucardo:yourpassword -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF

Re: [Bucardo-general] Bucardo add sync failed

2017-06-07 Thread Greg Sabino Mullane
As long as the function already exists, it can be created at any time. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP signature ___ Bucardo-

Re: [Bucardo-general] Can bucardo continue sync to master after slave server reboot?

2017-06-02 Thread Greg Sabino Mullane
on the slave server? Generally it is better to run it only on the master server. Either way, you can set the piddir to something else by adding this to your ~/.bucardorc file: piddir=/tmp -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B

Re: [Bucardo-general] Problem with ever growing delta and track tables...

2017-05-30 Thread Greg Sabino Mullane
syncs specified for it. A brute force solution is to truncate this table then run: bucardo validate all Which in theory will correctly populate the table. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signatu

Re: [Bucardo-general] Miscellaneous number of rows with bucardo 5.4.1 logical replication in the table where there are child tables

2017-05-23 Thread Greg Sabino Mullane
esume it has an identical schema. If not, you will need to add the trigger so that the inherited tables are populated. It should have the ame trigger and supporting function as the source database: the only change will be to set it to 'always' fire. -- Greg Sabino Mullane g...@endpoint.com

Re: [Bucardo-general] [HELP] bucardo: sync status "Begin txn" and tables are not updated

2017-05-15 Thread Greg Sabino Mullane
that does the vacuuming for you, so make sure that it is still enabled by doing: bucardo show bucardo_vac It should show: bucardo_vac = 1 -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP

Re: [Bucardo-general] [HELP] bucardo: sync status "Begin txn" and tables are not updated

2017-05-05 Thread Greg Sabino Mullane
e to disable. It was an optimization that doesn't work as well as hoped. We will probably disable it by default in the next version and see if it can be improved. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc

Re: [Bucardo-general] [HELP] bucardo: sync status "Begin txn" and tables are not updated

2017-05-05 Thread Greg Sabino Mullane
, the quick_delta function may be slowing you down. Try adding this line to your .bucardorc file: quick_delta_check=0 -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Descripti

Re: [Bucardo-general] CentOS 7: /var/run/bucardo disappeared after reboot

2017-04-18 Thread Greg Sabino Mullane
user running bucardo: echo "piddir=/tmp" >> ~/.bucardorc Or globally on the box: echo "piddir=/tmp" >> /etc/bucardorc -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC

Re: [Bucardo-general] Column order and foreign key

2017-03-24 Thread Greg Sabino Mullane
orking as it should, the safest bet would be to stop Bucardo, make the changes, and restart Bucardo. I'm still not sure I understand why this is happening - any chance you can enable logging on those servers and see the COPY commands in question? -- Greg Sabino Mullane g...@endpoint.com End

Re: [Bucardo-general] Column order and foreign key

2017-03-23 Thread Greg Sabino Mullane
onstraint? Bucardo sets session_replication_role, and thus ignores all triggers and rules (foreign keys are trigger based) -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc De

Re: [Bucardo-general] Pushdelta sync with a PG snapshot / restore fails to work bucardo 5.4.1

2017-02-15 Thread Greg Sabino Mullane
which is still trying to run bucardo_delta_check(). Kill all your Bucardo proceses, make sure nothing is still running by checking pg_stat_activity, then add this to your ~/.bucardorc file: quick_delta_check=0 Then restart Bucardo and see what happens. -- Greg Sabino Mullane g...@endpoint.com E

Re: [Bucardo-general] Change column type

2017-02-14 Thread Greg Sabino Mullane
eal, and generally requires updating the internal Bucardo tables as well as a full restart. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP signature ___

Re: [Bucardo-general] Master - multiple slave replication problem

2017-01-27 Thread Greg Sabino Mullane
Bucardo, and check the log file (log.bucardo) for any clues if things are still not working. It would also help to send us the output of: bucardo list all -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.as

Re: [Bucardo-general] onetimecopy=1 (fullcopy) replica not the same number records all tables

2017-01-26 Thread Greg Sabino Mullane
h_events_y2015_m11 FOR > EACH STATEMENT EXECUTE PROCEDURE bucardo_note_truncation('the_sync') Was this the master or the replica? Maybe you can send me the output of: bucardo show all (sending private is fine if you don't want to send to the list) -- Greg Sabino Mullane g...@endpoint.com End Poin

Re: [Bucardo-general] onetimecopy=1 (fullcopy) replica not the same number records all tables

2017-01-26 Thread Greg Sabino Mullane
an area that is highly used: it is also possible Bucardo is missing, for example, and ONLY somewhere in its calls, which would further gum things up, as generally, we do not want to involve child tables unless being explicit. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP

Re: [Bucardo-general] DBI connect

2017-01-24 Thread Greg Sabino Mullane
dauth: no password supplied at ./bucardo line 8691 Try creating an entry in the .pgpass file of the user you are running as. Something like this: echo "127.0.0.1:5432:*:bucardo:passwordhere" >> ~/.pgpass -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2

Re: [Bucardo-general] Recover bucardo "hole" in sync

2017-01-23 Thread Greg Sabino Mullane
icated rows) from the bucardo logs. Setting up a "modified" column in each table would be another solution. It could be a timestamp, a serial, or even just a boolean that gets set to true on any change, and your audit process then changes it back to false when done checking that r

Re: [Bucardo-general] missing table bucardo_truncate_trigger

2017-01-20 Thread Greg Sabino Mullane
d as part of the validation step. Something probably went wrong - try a manual kickoff like so: bucardo validate all -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP

Re: [Bucardo-general] Sync Issues.

2017-01-20 Thread Greg Sabino Mullane
update table mytable set strict_checking=0 -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP signature ___ Bucardo-general mailing list Bucardo-g

Re: [Bucardo-general] Recover bucardo "hole" in sync

2017-01-19 Thread Greg Sabino Mullane
es like this: (13639) [Fri Jan 13 17:38:10.588 2017] #10014 KID (mongo) Rows copied to (postgres) C.public.bucardo_test9: 1 If you can describe what you are looking for in more detail, there may be some different options, but that's the first thing that springs to mind. -- Greg Sabino Mullane

Re: [Bucardo-general] onetimecopy sync

2017-01-17 Thread Greg Sabino Mullane
eral idea is that it is a type of database target, so you would set one (or more of the DBs as a "source", and one or more as "fullcopy" like this: bucardo add sync foobar herd=myherd dbs=A:source,B:fullcopy -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP

Re: [Bucardo-general] Replication won't start.

2017-01-14 Thread Greg Sabino Mullane
d solution for production. Agreed, not ideal: you want to use 'md5' instead of 'peer' or 'trust'. Then you can store the password in the ~postgres/.pgpass file. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc D

Re: [Bucardo-general] What's wrong ?

2017-01-10 Thread Greg Sabino Mullane
this in your ~/.pgpass file: localhost:5432:bucardo:bucardo:somepassword Where "somepassword" is replaced with the actual password of course. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP signature _

Re: [Bucardo-general] Recover bucardo "hole" in sync

2017-01-08 Thread Greg Sabino Mullane
ectly rather than letting the bucardo triggers do it by touching the rows. A bit complicated, but you can get help on #bucardo at irc.freenode.net or here. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc D

Re: [Bucardo-general] Is it possible to use RDS Postgres Read Only Replicas as a source for replication?

2017-01-02 Thread Greg Sabino Mullane
t; no appreciable lag caused by the remote databases replicating data in. Excellent, glad to hear this. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Descr

Re: [Bucardo-general] Is it possible to use RDS Postgres Read Only Replicas as a source for replication?

2017-01-02 Thread Greg Sabino Mullane
o connect as a non-superuser, since we would not need to do any session_replication_role changes on the master. Maybe a change we should make anyway... /wild_speculation -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 sign

Re: [Bucardo-general] Tables with no primary key.

2016-10-21 Thread Greg Sabino Mullane
s, although that may be a little more involved than running those two statemnts. :) -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP signature ___

Re: [Bucardo-general] ubuntu 14 /var/run/bucardo issue and startup batch

2016-10-20 Thread Greg Sabino Mullane
ething that won't go away, like /tmp: echo piddir=/tmp >> /etc/bucardorc -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP signature ___ Buc

Re: [Bucardo-general] Master-Slave Setup?

2016-10-06 Thread Greg Sabino Mullane
On Thu, Oct 06, 2016 at 12:33:49PM -0700, Periko Support wrote: > Bucardo user inside postgresql DB must be superuser? > Or this step can be done with postgres main user? > thanks. Yes, bucardo user must be a superuser, but either can be used to create the language. -- Greg Sabino

Re: [Bucardo-general] Bucardo error

2016-09-22 Thread Greg Sabino Mullane
On Thu, Sep 22, 2016 at 06:00:33PM +0300, Danil Rakevich wrote: > I have tried this: > > RETURN 'Tables processed: ' || total::text; Thanks, have pushed it to the repo. And thanks for reporting this! -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A

Re: [Bucardo-general] Bucardo error

2016-09-22 Thread Greg Sabino Mullane
ext || total; Could you see if that is a valid solution for your version of Postgres? -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP signature ___

Re: [Bucardo-general] recover unsincronized data

2016-09-15 Thread Greg Sabino Mullane
So the bucardo database was on A, and was doing multi-master replication between A and B, and A suffered some sort of failure but is back up now? -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc D

[Bucardo-general] Github as primary resource

2016-08-31 Thread Greg Sabino Mullane
are a contributor, please send me your github username. Another announcement will go out once the change has been made. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 2529 DF6A B8F7 9407 E944 45B4 BC9B 9067 1496 4AC8 signature.asc Description: PGP signature

Re: [Bucardo-general] Bucardo Crash

2016-06-16 Thread Greg Sabino Mullane
sync! > > I guess that's the first thing to fix… Any progress on this? -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: PGP signature ___ Bucardo-general mailing list Bucardo-general

Re: [Bucardo-general] Invalid log level

2016-06-03 Thread Greg Sabino Mullane
"Invalid log_level!\n"; +die "Invalid log_level! ($setting)\n"; } $config{log_level_number} = $newvalue; } -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8

Re: [Bucardo-general] resync a table

2016-05-04 Thread Greg Sabino Mullane
bucardo channel at irc.freenode.net. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: PGP signature ___ Bucardo-general mailing list Bucardo-general@bucardo.org https://mail.endcrypt.com/mailman/l

Re: [Bucardo-general] error to install plperl

2016-02-21 Thread Greg Sabino Mullane
rl? Are there any perl-related files inside of /usr/pgsql-9.4/share/extension/ ? -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: PGP signature ___ Bucardo-general mailing list Bucardo-ge

Re: [Bucardo-general] MongoDB replication from postgres using Bucardo, after bucardo kick there is no results in bucardo status

2016-02-04 Thread Greg Sabino Mullane
ion of Bucardo (e.g. not HEAD) and a slightly older MongoDB driver (I think that means <- 1.0.4). If you still see issues with that version, please let us know. You are also welcome to test on -HEAD: I think we are fairly close to getting it working. -- Greg Sabino Mullane g...@endpoint.com End

Re: [Bucardo-general] speeding up bucardo.validate_sync

2016-01-13 Thread Greg Sabino Mullane
ange to make. Feel free to make a github pull request if you want to get in the habit, or I can just make it directly. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: PGP signature ___ Buc

Re: [Bucardo-general] Design of new txntime field

2015-12-04 Thread Greg Sabino Mullane
t; > > The bigint serial is the neatest idea so far. Anyone else want to comment? I've resigned myself to give up on the timestamp in the name of simplicity and correctness, but am open to alternative suggestions. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP K

Re: [Bucardo-general] Design of new txntime field

2015-11-07 Thread Greg Sabino Mullane
into the mix too. Would certainly win the space and efficiency awards. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: PGP signature ___ Bucardo-general mailing list Bucardo-g

Re: [Bucardo-general] One master - multiple slaves

2015-11-06 Thread Greg Sabino Mullane
for each slave? That is correct. Solving that problem is a highly wanted TODO item, but for now if you want things to keep chugging along when one goes down, have two syncs. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description

Re: [Bucardo-general] excuseme why the State is always by "Begin txn"

2015-11-05 Thread Greg Sabino Mullane
ry from going any further, so you should examine pg_stat_activity (look for waiting='t') and pg_locks. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: PGP signature ___ Bucardo-gene

Re: [Bucardo-general] Fwd: Syncing smaller batches

2015-11-04 Thread Greg Sabino Mullane
nical way to kick a sync is through the bucardo script. Anyone can run it, as long as things are configured correctly. You can also trigger it by sending a special database NOTIFY command. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc De

Re: [Bucardo-general] Fwd: Syncing smaller batches

2015-11-03 Thread Greg Sabino Mullane
rmance looks a lot better.: Excellent, thanks for that! I will look it over and try it out soon. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: PGP signature ___ Bucardo-general mailing li

Re: [Bucardo-general] Syncing smaller batches

2015-11-02 Thread Greg Sabino Mullane
e delta changes? No, it is all or nothing, to keep the database consistent. Is there some problem that doing partial records would solve for you? Maybe there is a different solution. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description

Re: [Bucardo-general] Fwd: Syncing smaller batches

2015-11-02 Thread Greg Sabino Mullane
ay help in your circumstance. Either way, it would be good to see where the pain points are: maybe you could email me some log output? -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: PGP signature ___

Re: [Bucardo-general] installation of bucardo 5.4.1

2015-10-05 Thread Greg Sabino Mullane
in @INC This means you need to install the Perl module DBI, one of the prerequisites for Bucardo. You should have received a warning aout that when you did the step: perl Makefile.PL Your best bet would be to install DBI (and more specifically, DBD::Pg) using Solaris' package management

Re: [Bucardo-general] Bucardo 5.4 replication with 2db with no primary key in some tables

2015-09-29 Thread Greg Sabino Mullane
alidate process. > > How can I use bucardo in this situation ? The best solution is to give those tables a primary key (or a unique index). It is far more efficient to only copy the rows that have changed than to have to copy the entire table every time the sync runs. -- Greg Sabino Mullane

Re: [Bucardo-general] bucardo doesn't sync tables without any error

2015-08-24 Thread Greg Sabino Mullane
been many changes in that part of the code recently. The 'clone' system, once finished, should obsolete both 'fullcopy' and 'onetimecopy'. Sorry for all the confusion. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital

Re: [Bucardo-general] master/master with bulk updates, load balanced

2015-08-24 Thread Greg Sabino Mullane
to handle them. You might want to use the offset-sequence trick [1] as well to help prevent conflicts and for better auditing. [1] Server A does 1,3,5,7,... Server B does 2,4,6,8, etc. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description

Re: [Bucardo-general] automating installation

2015-08-21 Thread Greg Sabino Mullane
On Fri, Aug 21, 2015 at 06:29:29PM -0700, Florin Andrei wrote: So, is there a non-interactive installation method that I could use? Yes, the --batch argument is meant to facilitate this. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc

Re: [Bucardo-general] many-to-many Problem

2015-08-19 Thread Greg Sabino Mullane
objects at /usr/local/share/perl/5.14.2/Bucardo.pm line 9466 Is that the exact error message? As far as I know, we have never had a variable named $nor. What version is this? -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital

Re: [Bucardo-general] bucardo doesn't sync tables without any error

2015-08-18 Thread Greg Sabino Mullane
a manual copy of the data, or touch all the rows on the source. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature ___ Bucardo-general mailing list Bucardo-general

[Bucardo-general] Bucardo version 5.4.0 released

2015-08-12 Thread Greg Sabino Mullane
number of pending delta rows on source databases. [Greg Sabino Mullane] - Fix incorrect usage of the 'dbconn' parameter in the bucardo.db table [Greg Sabino Mullane, reported by Alexandre Busquets] - Fix case where VAC sometimes skipped databases used in multiple syncs. [Greg

Re: [Bucardo-general] [Bucardo-announce] Bucardo version 5.4.0 released

2015-08-12 Thread Greg Sabino Mullane
the new release so quickly! -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature ___ Bucardo-general mailing list Bucardo-general@bucardo.org https://mail.endcrypt.com/mailman

Re: [Bucardo-general] sending data from postGreSQL to hbase/cassandra

2015-08-03 Thread Greg Sabino Mullane
this. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature ___ Bucardo-general mailing list Bucardo-general@bucardo.org https://mail.endcrypt.com/mailman/listinfo/bucardo-general

Re: [Bucardo-general] Custom cols not working.

2015-08-03 Thread Greg Sabino Mullane
and the customcols? -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature ___ Bucardo-general mailing list Bucardo-general@bucardo.org https://mail.endcrypt.com/mailman/listinfo

Re: [Bucardo-general] error while syncing

2015-08-03 Thread Greg Sabino Mullane
, but there are cases where it will stop retrying, depending on the nature of the error. As far as detecting bad sync, you can use bucardo status syncname to see if the last run completed, and if it was good or bad. We will be happy to give more answers if you have more specific questions. -- Greg Sabino

Re: [Bucardo-general] BUG. VAC process disabled for some databases

2015-07-28 Thread Greg Sabino Mullane
(round $t-{delete_round} of $t-{delete_rounds}), LOG_DEBUG); $did_something++; -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature ___ Bucardo-general mailing

Re: [Bucardo-general] Merging two datasets

2015-07-25 Thread Greg Sabino Mullane
. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature ___ Bucardo-general mailing list Bucardo-general@bucardo.org https://mail.endcrypt.com/mailman/listinfo/bucardo-general

Re: [Bucardo-general] Bucardo behaviour with temporarily unreachable hosts

2015-07-03 Thread Greg Sabino Mullane
. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature ___ Bucardo-general mailing list Bucardo-general@bucardo.org https://mail.endcrypt.com/mailman/listinfo/bucardo-general

Re: [Bucardo-general] No automatic kick/ping after onetimesync

2015-07-03 Thread Greg Sabino Mullane
to, but since a manual kick works, that's a mystery, as the manual kick should be issuing the exact same NOTIFY the trigger does. Double check the triggers and functions on one of those tables and make sure it is issuing the correct NOTIFY. -- Greg Sabino Mullane g...@endpoint.com End Point

Re: [Bucardo-general] Table to table sync not syncing

2015-06-07 Thread Greg Sabino Mullane
Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature ___ Bucardo-general mailing list Bucardo-general@bucardo.org https://mail.endcrypt.com/mailman/listinfo/bucardo-general

Re: [Bucardo-general] How to make syncs active when one of the node is down

2015-06-03 Thread Greg Sabino Mullane
, as Bucardo needs active, serializable, concurrent transactions most of the time. You may get more benefit by having the KID and CTL processes exit when done, by setting kidsalive=0 and stayalive=0 for each sync. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8

Re: [Bucardo-general] installation support

2015-06-03 Thread Greg Sabino Mullane
using /tmp, so you are probably using Debian (or Ubuntu). The easiest solution may be to simply adjust your postgresql.conf and add /tmp to your unix_socket_directories. That way programs are happy no matter which socket directory they expect. -- Greg Sabino Mullane g...@endpoint.com End Point

Re: [Bucardo-general] Problems syncing multiple databases

2015-06-01 Thread Greg Sabino Mullane
commands you are trying, but if you want to add a table from a specific database, you can add the database to the end of the add table command like so: bucardo add table foobar db=DB2 -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description

Re: [Bucardo-general] Problems syncing multiple databases

2015-06-01 Thread Greg Sabino Mullane
db1_remote:target bucardo add sync db1_sync relgroup=group1 dbs=db1_dbgroup autokick=0 -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature ___ Bucardo-general mailing list Bucardo-general

Re: [Bucardo-general] Alter tables

2015-05-21 Thread Greg Sabino Mullane
to reload the sync: $ bucardo reload sync foobar You may see some errors if a sync starts up after you ALTER and before the sync reloads, but as long as the changes do not involve the primary keys, it should work. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key

Re: [Bucardo-general] Error bucardo target MySQL

2015-05-19 Thread Greg Sabino Mullane
On Mon, May 18, 2015 at 10:32:49AM -0300, Rangel Nunes wrote: Error attached Thanks for the report, I will see if I can duplicate (and hopefully fix) -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature

Re: [Bucardo-general] bucardo internals and updates

2015-05-11 Thread Greg Sabino Mullane
the default trigger behavior (e.g. 'origin', not 'always'), work for you? There are some other workarounds that should be tried before resorting to setting triggers as 'always'. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital

Re: [Bucardo-general] bloated bucardo 5 delta tables

2015-04-25 Thread Greg Sabino Mullane
be getting cleaned up automatically. The latest version has no specific vcacuum related fixes. Perhaps looks at your bucardo_delta_names tables and make sure you don't have any duplicated or stale entries. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8

Re: [Bucardo-general] Error after upgrade from 4.99.10

2015-04-25 Thread Greg Sabino Mullane
-{server_side_prepares}; $ssp = 1 if ! defined $ssp; -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature ___ Bucardo-general mailing list Bucardo-general@bucardo.org https

Re: [Bucardo-general] Error after upgrade from 4.99.10

2015-04-23 Thread Greg Sabino Mullane
of the bucardo.db table, and make sure it says sslmode=require, not conn=sslmode=require -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature ___ Bucardo-general mailing list Bucardo

Re: [Bucardo-general] Fix build with Perl 5.21.6+

2015-04-20 Thread Greg Sabino Mullane
in 3a6cdce7e60de30a3da6f2dc8698ee2124201c9b -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature ___ Bucardo-general mailing list Bucardo-general@bucardo.org https://mail.endcrypt.com/mailman/listinfo

Re: [Bucardo-general] Remove tables that have same name

2015-03-12 Thread Greg Sabino Mullane
On Wed, Mar 04, 2015 at 10:11:48AM +0100, Laurent GARCES wrote: Wiki updated: https://bucardo.org/wiki/Bucardo/remove_table Hope that will be ok. Looks great, thanks for all the wiki changes! -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc

Re: [Bucardo-general] Bucardo weird errors on buzy system

2015-02-25 Thread Greg Sabino Mullane
is going on. Try bumping the log_level up (perhaps to DEBUG) and see if that gives you a better message. -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature ___ Bucardo

Re: [Bucardo-general] Remove tables that have same name

2015-02-25 Thread Greg Sabino Mullane
: bucardo remove table public.foobar db=bazzo Documentation patches welcome :) -- Greg Sabino Mullane g...@endpoint.com End Point Corporation PGP Key: 0x14964AC8 signature.asc Description: Digital signature ___ Bucardo-general mailing list Bucardo-general

Re: [Bucardo-general] Bucardo weird errors on buzy system

2015-02-21 Thread Greg Sabino Mullane
I will reply to the other questions when I have some time, but this one is easy: 2) Is there a way to get rid of those errors? I guess they are related to the fact the sync are not refreshed. Upgrading to the latest bucardo (5.3.1) should remove those errors -- Greg Sabino Mullane g

  1   2   3   >