and look into why parsecvs trips up on
those 3 files from REL8_0_0 branch ;-)
a.
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca command like a king,
http://www.highrise.ca/ work
* Markus Wanner mar...@bluegap.ch [090529 11:18]:
Hi,
Quoting Aidan Van Dyk ai...@highrise.ca:
* Markus Wanner mar...@bluegap.ch [090529 11:06]:
Comparison of the head of each branch between git and CVS (modulo CVS
keyword expansion, which I've filtered out):
How did you filter it out
* Alvaro Herrera alvhe...@commandprompt.com [090529 11:45]:
Aidan Van Dyk wrote:
Yes, but the point is you want an exact replica of CVS right? You're
git repo should have $PostgreSQL$ and the cvs export/checkout (you do
use -kk right) should also have $PostgreSQL$.
The 3 parsecvs
* Robert Haas robertmh...@gmail.com [090527 22:43]:
On Wed, May 27, 2009 at 10:09 PM, Aidan Van Dyk ai...@highrise.ca wrote:
* Robert Haas robertmh...@gmail.com [090527 21:30]:
And actually looking at the history of the gpo repo, the branches are all
messed up with merges and stuff
* Robert Haas robertmh...@gmail.com [090528 09:49]:
On Thu, May 28, 2009 at 8:59 AM, Aidan Van Dyk ai...@highrise.ca wrote:
All that based on the assumption that when the project switches to git,
they actually want all the CVS history in their official tree. Its
certainly not necessary
* Aidan Van Dyk ai...@highrise.ca [090527 17:22]:
And actually looking at the history of the gpo repo, the branches are all
messed up with merges and stuff that I'm not sure where they are coming
from... 8.2, 8.3, and master(HEAD) are all the same as my gpo repo, but the
back branchs
access to the files/directories of the git repo
(much like I'm assuming the current CVS master is). And that's pushed
out to any number of other places, either from cron, or post-receive
hooks.
a.
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca
* Aidan Van Dyk ai...@highrise.ca [090528 15:56]:
Ok, so seeing the interest in having a good conversion, I took a stab at
parsecvs this afternoon, probably what I consider the leading static
conversion tool.
It takes about 10 minutes to run my old xeon.
And a comparison between it's
and based on cvs2svn...
If anybody can confirm that the incremental git cvsimport can follow a
recent cvs2git conversion, that would definitely be awesome! If I can
come across a few free hours some time, I might even try it myself!
a.
--
Aidan Van Dyk Create
the first run after any conversion carefully.
a.
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca command like a king,
http://www.highrise.ca/ work like a slave
into your history, your your new development grafted on to the
official history...
But, if there is nothing wrong with the current repo (except that it
doesn't have tags), than we can easily add tags to it...
a.
--
Aidan Van Dyk Create like a god,
ai
the same as my gpo repo, but the
back branchs are very bad...
a.
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca command like a king,
http://www.highrise.ca/ work like a slave
the project deems the official git repository, people
will be able to continue to keep their current investment in git
development with stuff like grafts, filter-branch, rebase, etc.
a.
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca
* Tom Lane t...@sss.pgh.pa.us [090526 11:20]:
Aidan Van Dyk ai...@highrise.ca writes:
This has been raised and ignored many times before on -hackers... The
reason is because the tags in the CVS repository are broken (i.e they
are such that it's impossible to actually create all the tags
/port/snprintf.c)
regards, tom lane
So what part of a working libc does PG use that it *doesn't* have to
carry around in src/port/?
;-)
a.
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca
the system
to work...
a.
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
Description: Digital
:
http://www.postgresql.org/mailpref/pgsql-hackers
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca command like a king,
http://www.highrise.ca/ work like a slave
/PostgreSQL$ apt-cache show libxml2
libjson-glib-1.0-0 libglib2.0-0 | grep ^Size
Size: 870188
Size: 36132
Size: 845166
glib also pulls in libpcre:
Size: 214650
So:
- XML: 870188(libxml) + 76038 (zlib1g) = 946226
- JSON: 36132 (json) + 845166 (glib) + 214650 (pcre) = 1095948
;-)
--
Aidan Van Dyk
.
And it leads to an easy way for people to change public (in the
search path and/or schema.table) to do other things (although I'm
not saying that's necessarily required or desired either).
a.
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca
* Tom Lane t...@sss.pgh.pa.us [090507 12:53]:
Aidan Van Dyk ai...@highrise.ca writes:
... couldn't we just
make new pgbench refer to tables as schema.table where schema is
public?
I'd prefer not to do that because it changes the amount of parsing work
demanded by the benchmark. Maybe
* Joshua D. Drake j...@commandprompt.com [090507 13:02]:
On Thu, 2009-05-07 at 12:58 -0400, Aidan Van Dyk wrote:
True enough... What about making the prefix be configurable, so by
default, it could be pgbench_, it could be set to (to force it to
use old pgbench names) or set to something
to be insulting?
--
Andy Lester = a...@petdance.com = www.theworkinggeek.com = AIM:petdance
--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers
--
Aidan Van Dyk
:
#ifdef NEED_NGETTEXT
#define ngettext(s,p,n) gettext((n)==1?(s):(p))
#endif
Or a real port function:
const char* ngettext (const char*s, const char*p, int n)
{
return gettext(n == 1 ? s : p);
}
a.
--
Aidan Van Dyk
the parameter.
That's what we currently have without HS, but people aren't completely
satisfied with it either ;-)
a.
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca command like a king,
http://www.highrise.ca
over the network, you can't do anything... Not to mention, merging,
repeatedly, rebasing,
etc ;-)
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca command like a king,
http://www.highrise.ca
to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca command like a king,
http://www.highrise.ca/ work like
clear it
wasn't something people (other than a few of us) were willing to
allow...
a.
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca command like a king,
http://www.highrise.ca
it once when you start using the file and once
when it's finished.
It would break the WAL write-block/sync-block forward only progress of
the xlog, which avoids the whole torn-page problem that the heap has.
a.
--
Aidan Van Dyk Create like a god,
ai
up correctly, you get these spikes
But even with these spikes, it's plenty fast enough for the stuff I've
done...
a.
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca command like a king,
http
* Bruce Momjian br...@momjian.us [090108 16:43]:
The attached patch from Aidan Van Dyk zeros out the end of WAL files to
improve their compressibility. (The patch was originally sent to
'general' which explains why it was lost until now.)
Would someone please eyeball it?; it is useful
* Peter Eisentraut pete...@gmx.net [090102 18:33]:
On Friday 02 January 2009 23:33:34 Aidan Van Dyk wrote:
Has this gone anywhere? Is the CVS repo safe yet?
Nothing has been done about this.
So, what's the concensus. Are we(you,everybody?) going to leave the CVS
repo alone, or is someone
-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca command like a king,
http://www.highrise.ca
been able to fix those yet.
--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca
certatily *don't* want to loose the ability
to use WAL archiving, because I ship my WAL off-site too...
The ability to have an extra local copy is good. But I'm certainly not
going to want to give up my off-site backup/WAL for it...
a.
--
Aidan Van Dyk
subscription:
http://www.postgresql.org/mailpref/pgsql-hackers
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca command like a king,
http://www.highrise.ca/ work like a slave
of those (and probably other) being usefull and
used.
But in the current patch, it focusses on the streaming (sending), and
and a receiver recovery mode that can accept/apply them, again,
without worrying about acutally running queries (yet) ...
a.
--
Aidan Van Dyk
backend...
a.
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
Description: Digital signature
* Jeff Davis pg...@j-davis.com [081212 13:41]:
On Fri, 2008-12-12 at 08:57 -0500, Aidan Van Dyk wrote:
For (2) we need a full interlock. Given that we don't currently support
multiple streamed standby servers, it seems not much point in
implementing the interlock (2) would require
* Simon Riggs [EMAIL PROTECTED] [081211 05:45]:
On Wed, 2008-12-10 at 15:06 -0500, Aidan Van Dyk wrote:
Call me think, but I'm confused... In sync rep, there *can't be* any
catchign up do do... i.e. if the slave isn't accepting the WAL the
master stops doing *anything*...
In normal
*not* going to throw all my eggs into that slave's
basket and do away with my WAL archive... Would anyone actually use
that standby mode, and if not, why compilcate the code for it?
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED
comfortably at night ;-)
I'm just suprised that people are willing to throw away their
backup/PITR archiving once they have a singl live slave up.
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like
* Heikki Linnakangas [EMAIL PROTECTED] [081211 10:09]:
Simon Riggs wrote:
On Thu, 2008-12-11 at 09:27 -0500, Aidan Van Dyk wrote:
But catchup *has* to be *done* before PostgreSQL can enter sync rep.
Not true. Please reread the thread where Heikki questions that and I
reply. This was Fujii
-level)
does itself...
So, if row-level access comes to PG in any sql form, apps and others
will use it (if only a few of them)... And se-linux on top of that will
be used to try and enforce that the app hasn't made a mistake...
a.
--
Aidan Van Dyk Create
pg-clients able to do anything if
sync-rep isn't happenning...
a.
--
Aidan Van Dyk Create like a god,
ai...@highrise.ca command like a king,
http://www.highrise.ca/ work like a slave
* then connect and allow sync rep
2. Preferred Choice
* connect to primary and allow sync rep
* catch up
Call me think, but I'm confused... In sync rep, there *can't be* any
catchign up do do... i.e. if the slave isn't accepting the WAL the
master stops doing *anything*...
--
Aidan Van Dyk
you call it is still arbitrary... But where that line is drawn
currently defined in the buildfarm code...
Not that it can't be changed, but I thin there's much better things to
worry about ;-)
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED
) bias is showing, but nobody else has (yet)
showed otherwise ;-)
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave
. then your
consitent. At least as consistent as the original write was.
So you're CRC ends up being:
Buffer the page
Calculate CRC on the buffered page
WAL (in bulk) the hint bits (and maybe CRC?)
write buffered page
--
aidan van dyk create
* Tom Lane [EMAIL PROTECTED] [081118 12:43]:
Aidan Van Dyk [EMAIL PROTECTED] writes:
But why can't you wal-log the hint bits from the buffered page. then your
consitent. At least as consistent as the original write was.
So you're CRC ends up being:
Buffer the page
Calculate
, not dirty with
already-wal-logged changes)
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
up?
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
Description: Digital signature
* Matthew T. O'Connor [EMAIL PROTECTED] [081117 15:19]:
Aidan Van Dyk wrote:
* Greg Stark [EMAIL PROTECTED] [081117 03:54]:
I thought of saying that too but it doesn't really solve the problem.
Think of what happens if someone sets a hint bit on a dirty page.
If the page is dirty from
that to be able
to checksum the special space as well.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
WAL logged even for blocks written that aren't hint-bit only
You trade WAL and simplicity for verifiable integrety.
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http
any time in the near future...
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
Description
* to get a WAL backup of the block at some *any* point before the
block's written to save from the torn-page on recovery leading to an
inconsistent CRC.
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command
-- a
usage: diff [ -C n ] [ -S name ] [ -bcefhilnrstw ] dir1 dir2
diff [-C n ] [ -bcefhintw ] file1 file2
diff [ -D string ] [ -biw ] file1 file2
I'll bet /usr/bin/make pukes on PostgreSQL make files there too ;-)
a.
--
Aidan Van Dyk
the code a bit better...
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
Description: Digital
be = the time of
the write() syscall... Your fsync is your on disk guarentee, not the
write, and that won't change.
But I thought you didn't really care about hint-bit updates, even in the
current strategy... but I'm fully ignorant about the code, sorry...
a.
--
Aidan Van Dyk
...
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
Description: Digital signature
CRC32 as well...
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
Description: Digital signature
* is irrelevant, because it wasn't read from disk, it was
completely constructed from WAL records, which are protected by
checksums themselves individually..., and is now ready to be written to
disk which will force a valid checksum to be on it.
a.
--
Aidan Van Dyk
), so on next read...
Without the CRC it doesn't matter, because the only change was
hint-bits, so the page is half-old+half-new, but new == old+only
hint-bits...
Because ther'es no WAP. the torn page will be read next time that buffer
is needed...
a.
--
Aidan Van Dyk
that aren't high-velocity can probably spare a bit more
Xlog bandwith anyways...
But my experience is limitted to my small-scale databases...
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like
calculate your CRC, you're doing it on a local copy of the block, which
you hand to the OS to write... If you're touching the whole block of
memory to CRC it, it isn't *ridiculously* more expensive to copy the
memory somewhere else as you do it...
a.
--
Aidan Van Dyk
with a very high
concurrency, high-write load...
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
many have just disabled it because it prevented what
they thought should be a valid operation?
I'm sure NSA can do both of these, but I would hazard that the number of
other people able to do this well can probably be counted on my
fingers...
a.
--
Aidan Van Dyk
, but can feed clients accross slow WAN links (that may not have
the burst bandwidth to keep up with bursty master writes, but have agregate
bandwidth to keep pretty close to the master), or networks that drop out
for a period, etc.
--
Aidan Van Dyk Create like
git, and thus has CVS+patch
locally available in 1 command anyways...
I think Git's use as #1 *has* to come first. And, because of it's
inherently distributed nature, #2 just happens once people are using
it...
a.
--
Aidan Van Dyk Create like a god
for that
publishing ;-)
But all that's only my opinion, so take it with a grain of salt, or
another pint ;-)
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca
cleanly).
The with_recursive branch doesn't seem to provide any of the nice
goodies that git could provide (i.e. patch history, merge corresponding
to various versions so you can easily see what changed, etc)
a.
--
Aidan Van Dyk Create like a god,
[EMAIL
... ;-)
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
Description: Digital signature
* Peter Eisentraut [EMAIL PROTECTED] [080606 08:25]:
Am Mittwoch, 4. Juni 2008 schrieb Aidan Van Dyk:
When reading this thread, I'm wondering if anybody ever saw a config
file for a complex software product that was easily editable and
understandable. I don't know one. If there was one
* David E. Wheeler [EMAIL PROTECTED] [080606 12:22]:
I guess that could be a feature. Personally, I use a vcs system for
that.
Bugger... Now we only need to make postgresql check postmaster.conf
into git everytime it makes a change...
;-)
--
Aidan Van Dyk
to be getting any closer to autotuning.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
Description
and
history the way I do my text-based #-commented config files.
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like
...
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
Description: Digital signature
(or all) of the
changes into postgresql.conf using my preferred method of
commenting/SCM/quirks.
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca
run an async slave for slow
reporting queries, and a sync slave for short queries.
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca
capabilities is limited to the
speed of the slaves single-threaded WAL application.
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work
on.
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
Description: Digital signature
%20Replication.pdf
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave.
signature.asc
Description: Digital signature
of personal taste. I guess with \df you have to accept that
it's always going to be ugly, unless you have a very wide terminal (or
very short function definitions!).
Isn't that what $PAGER is for?
$PAGER is the main reason why *I* don't want the wrapped format.
a.
--
Aidan Van Dyk
://archives.postgresql.org/message-id/[EMAIL PROTECTED]
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave
seem to work.
That's pretty straight forward, pretty explicit, and matches the
description of what Greg has been saying all along.
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http
/manual/html_node/General-output-formatting.html#General-output-formatting
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work
is properly escaped and sanitized, it
wouldn't be a problem. But if you are sure that all data is properly
escaped and sanitized, then the whole don't allow literals extra
protection isn't needed either, and you don't need to go looking for
ways to avoid the literals in queries.
--
Aidan Van
. This is why you need
a client-side solution such as tainting.
Well, just because a tool is available doesn't mean people have to use
it. I mean, we have PostgreSQL, and we think that's worth it, even
though to use it, everybody has to do significant revision of their
apps.
a.
--
Aidan Van Dyk
* Gregory Stark [EMAIL PROTECTED] [080429 14:20]:
Aidan Van Dyk [EMAIL PROTECTED] writes:
That said, though *I* like the idea (and since I develop against
PostgreSQL 1st and use params for my queries I would consider it a nice
tool to keep me honest), I can easily see that the cost
in the first case. In the other cases, the explicit:
VAR=... command
the shell is told to set VAR explicitly before starting command, in
addition to any exported vars.
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED
it could technically define exactly what the data is
it's trying to display, if it's different from everything else means I'm
going to avoid it as much as possible.
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED
.
That said, I really don't see myself using the wrapped format so maybe
my vote shouldn't count.
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca
* in the PG
source, they're needed in the typedef list. If they are not used in
the PG source, they aren't needed in the typedef list.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http
basis and produce a definitive list each and every
run.
a.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave
that their patch system doesn't work too well in
practice. ;-)
Perhaps Apache is a more mature technology or more poorly managed. I
can't imagine us requring an FAQ entry like that about ignored patches.
Well, currently *you* are the reason we don't ;-)
a.
--
Aidan Van Dyk
to worry about this
thing, I can delete it (and the followups to it) from my huge list
of even more things to look at without expending lots of time
re-reading the whole thread to make sure it didn't just die out
--
Aidan Van Dyk Create like a god
to it with my review.
Which would you honestly rather do?
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED] command like a king,
http://www.highrise.ca/ work like a slave
* Joshua D. Drake [EMAIL PROTECTED] [080410 11:55]:
On Thu, 10 Apr 2008 11:53:09 -0400
Aidan Van Dyk [EMAIL PROTECTED] wrote:
I can grab the messageid (or mhonorc url, I've got tools to get the
message id out if it), directly open the message in my reader of
choice, and have the patch
, manage threads of discussion, etc.
Basically, as Tom keeps saying the wiki is just an index into the
mailing list archives. Any tracker may be able to do that, with more or
less complexity.
--
Aidan Van Dyk Create like a god,
[EMAIL PROTECTED
* Joshua D. Drake [EMAIL PROTECTED] [080410 11:30]:
On Thu, 10 Apr 2008 11:15:08 -0400
Aidan Van Dyk [EMAIL PROTECTED] wrote:
* Where do I comment?
In your mail program.
To where? Development discussion is supposed to happen on -hackers but
a patch is likely on -patches
201 - 300 of 363 matches
Mail list logo
