function to unit test it, and send the patch when I'm done to
the patches list.
Any developers got some tips for me?
---
James
- Original Message -
From: Oleg Bartunov [EMAIL PROTECTED]
To: Bruce Momjian [EMAIL PROTECTED]
Cc: PostgreSQL-development [EMAIL PROTECTED]
Sent: Sunday, May 13, 2001
swapcache seems to me remarkably elegant and, it would seem,
very effective.
James
--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers
The processing functions have been extended to provide populate_record() and
populate_recordset() functions.The latter in particular could be useful in
decomposing a piece of json representing an array of flat objects (a fairly
common pattern) into a set of Postgres records in a single pass.
manipulations to one
statement per table per logical operation even where there are multiple
detail rows.
Sometimes the network latency can be a pain too and that also suggests
an RPC with unpack and insert locally.
Cheers
James
--
Sent via pgsql-hackers mailing list (pgsql-hackers
You can use COPY from a stored procedure, but only to and from files.
I think that's in the chocolate fireguard realm though as far as
efficiency for this sort of scenario goes, even if its handled by
retaining an mmap'd file as workspace.
If SPI provided a way to perform a copy to a
So, while no native 64-bit compilers are available for free as part of
Visual Studio Express 2012 (11), it doesn't matter much. The issue is
more that it's very much Microsoft's whim whether they release compilers
at all and if so, which ones, when and how.
I think I have a pretty vanilla
Anyway, this is getting way off track. The point is that the MS SDKs and
compilers are a bit of a mess and that MinGW support is useful because
we can't rely on them continuing to offer free SDKs and compilers in future.
Well, more compilers are always useful, but complaining that Microsoft
On the contrary, only a few months ago there was a far from groundless fear
that Microsoft would do just that. Following considerable outcry they changed
their mind. But this is definitely not just paranoia. As for w64 support, the
mingw-64 project exists more or less explicitly to produce 64
the parser drive a pull
loop, or use a coroutine structure.
Could go all trendy and use a PEG tool like, er,, peg
(http://piumarta.com/software/peg/). (I haven't tried them tho')
James
--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription
Doesn't that imply that a plan cache might be worthwhile?
But no matter: didn't the OP really have issue with packaging and
Windows support - and there are a lot of Windows users, and in general
there are many Windows devs: making it easier for them to contribute has
to be good doesn't it?
I believe there are tools that are significantly faster than flex. I
believe re2c generates code that is faster. But the key thing is to
test, probably, or perhaps ask around. I'm out of touch, but from
memory flex wasn't the be-all and end-all.
Lemon is definitely easy to maintain/port
That is, if you request FD_WRITE events for a pre-existing socket with
WSAEventSelect, you will not get one until the outbound network buffer has
been filled and then has partially emptied. (This is incredibly broken,
but Microsoft evidently has no intention of fixing it.)
I think you should
How easy would it be to implement a fake async rep target?
Perhaps even as something that a server could allow a connection to
request? (ie a suitably permissioned connection could convert itself to
receive n async replication stream, rather than being statically
configured?)
I know that
the
impacted tables and for each table a list of affected primary keys and
whether they were inserted, deleted or updated.
James
--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers
the
impacted tables and for each table a list of affected primary keys and
whether they were inserted, deleted or updated.
James
--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers
Have you considered GPU-based sorting? I know there's been discussion
in the past.
If you use OpenCL, then you can use a CPU driver if there is no GPU, and
that can allow you to leverage all the CPU cores without having to do
the multi-thread stuff in the backend.
While the compilation of
On 25/06/2013 05:16, Tom Lane wrote:
It might be time to reconsider whether we should move the baseline
portability requirement up to C99.
My understanding was that you picked up a lot of users when the Win32
port became useful. While you can build with msys, I would think that
leaving
On 01/07/2013 02:43, Claudio Freire wrote:
In essence, you'd have to use another implementation. CPython guys
have left it very clear they don't intend to fix that, as they don't
consider it a bug. It's just how it is.
Given how useful it is to have a scripting language that can be used outside
On 14/07/2013 20:13, Greg Smith wrote:
The most efficient way to write things out is to delay those writes as
long as possible.
That doesn't smell right to me. It might be that delaying allows more
combining and allows the kernel to see more at once and optimise it, but
I think the
On 05/01/2014 16:50, Robert Haas wrote:
But on Windows, segments are*automatically*
destroyed*by the operating system* when the last process unmaps them,
so it's not quite so clear to me how we can allow it there. The main
shared memory segment is no problem because the postmaster always has
On 05/01/2014 18:02, Robert Haas wrote:
On Sun, Jan 5, 2014 at 12:34 PM, jamesja...@mansionfamily.plus.com wrote:
On 05/01/2014 16:50, Robert Haas wrote:
But on Windows, segments are*automatically*
destroyed*by the operating system* when the last process unmaps them,
so it's not quite so
On 06/01/2014 03:14, Robert Haas wrote:
That's up to the application. After calling dsm_create(), you call
dsm_segment_handle() to get the 32-bit integer handle for that
segment. Then you have to get that to the other process(es) somehow.
If you're trying to share a handle with a background
On 06/01/2014 04:20, Amit Kapila wrote:
Duplicate handle should work, but we need to communicate the handle
to other process using IPC.
Only if the other process needs to use it. The IPC is not to transfer
the handle to
the other process, just to tell it which slot in its handle table
On 02/03/2014 15:30, Magnus Hagander wrote:
Terminal Services have definitely become more common over time, but
with faster and cheaper virtualization, a lot of people have switched
to that instead, which would remove the problem of course.
I wonder how common it actually is, though, to
On 03/10/2014 05:53, Kouhei Kaigai wrote:
Yep, that's my pain. Even though usual query does not take many buffers
pinned,
my use case needs to fetch megabytes scale data at once because of performance
reason; page-by-page synchronous scan makes GPU being idle.
Doesn't your GPU have an async
On 27/01/2016 13:30, Amit Kapila wrote:
Thoughts?
Are the decreases observed with SSD as well as spinning rust?
I might imagine that decreasing the wear would be advantageous,
especially if the performance decrease is less with low read latency.
--
Sent via pgsql-hackers mailing list
On 15/07/2016 09:28, Craig Ringer wrote:
I don't think anyone's considering moving from multi-processing to
multi-threading in PostgreSQL. I really, really like the protection
that the shared-nothing-by-default process model gives us, among other
things.
As I understand it, the main issue is
butt on the
line hosting our client's data.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 7: don't forget to increase your free space map settings
doing
this?
Cheers,
-James Rogers
[EMAIL PROTECTED]
---(end of broadcast)---
TIP 9: the planner will ignore your desire to choose an index scan if your
joining column's datatypes do not match
, which I
will post to the pg-hackers list. It is all stuff previously determined
to be doable within the current PostgreSQL framework, and just requiring
some work that my company is willing to help pay for.
Cheers,
-James Rogers
[EMAIL PROTECTED]
---(end of broadcast
performance by allocating most of the memory to the buffer cache rather
than leaving it to the kernel file cache.
I'm actually fairly curious to see what the new buffer management scheme
will mean in terms of real world performance and parameter tuning.
-James Rogers
[EMAIL PROTECTED
to solve at least the 'stay out of other
user's crud by default' issues.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 9: the planner will ignore your desire to choose an index scan if your
joining column's datatypes do not match
code ...
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 3: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to [EMAIL PROTECTED] so that your
message can get through to the mailing list
() does a lot of little itty bitty writes to the
frontend filedescriptor.
What do you get if you comment out that block in child.c, around line
372? Either a faster system or a non-working one?
James Robinson
Socialserve.com
---(end of broadcast
the CompleteCommandResponse
handler method ends with a call to pool_write_and_flush(), and
you've pretty much gotta get a CompleteCommand message
trailing all of those rows.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 1: subscribe
to manipulate temporary tables.
Quite spiffy, reducing the amount of surprise encountered by postgres
neophytes.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 5: Have you checked our extensive FAQ?
http://www.postgresql.org
I want to understand how Postgres organizes data and handles IO
operations so that I will better know how to optimize a Postgres
database server. I am looking for answers to specific questions and
pointers to where this stuff is documented.
How does Postgres organize its data? For example, is it
Has there been any thought of providing RAW disk support to bypass the fs?
-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED]]On Behalf Of Bruce Momjian
Sent: Thursday, September 26, 2002 3:57 PM
To: Neil Conway
Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED];
[EMAIL
at least doing they want.
I've probably not said this before, but I appreciate all the hard work that
everyone puts into this project.
James Hubbard
---(end of broadcast)---
TIP 4: Don't 'kill -9' the postmaster
these unscientific tests you're telling us
about being so successful for some months?
Vince.
I open my mouth and insert foot: Where do I get any of these scientific
tests to determine if the latest and greatest 7.3.x will not fall down on my
favorite Unix?
James Hubbard
:
http://kerneltrap.org/node.php?id=327
The actual link to the source
http://www.freebsd.org/cgi/cvsweb.cgi/src/tools/regression/fsx/
James
---(end of broadcast)---
TIP 4: Don't 'kill -9' the postmaster
Tom Lane wrote:
That really should be impossible --- it says that a rename() failed for
a file we just created.
I judge from the spelling of the error message that you are running 7.1.
7.1.3
However, given that you state a system reboot is necessary and
sufficient to make the problem go
Tom Lane wrote:
James Thornton [EMAIL PROTECTED] writes:
I am not running NFS on this system.
Oh well, scratch that theory. Perhaps you should tell us what you *are*
running --- what OS, what hardware? I still believe that this must be
a system-level bug and not directly Postgres
I upgrade from PG 7.1.3 to 7.2, and I am trying to restore my dbs but I
keep getting:
[nsadmin@roam backup-20020622]$ pg_restore all-good.dmp
pg_restore: [archiver] input file does not appear to be a valid archive
---(end of broadcast)---
TIP 2:
-to for using Open Office and unixODBC
http://www.unixodbc.org/doc/OOoMySQL.pdf
Others are considering MySQL.
http://dba.openoffice.org/proposals/MySQL_OOo.html
James Hubbard
Dave Cramer wrote:
IMO One of the big reasons that MySQL is viewed as being better is it's
percieved simplicity. It has a large
Is there a bug tracking system someone online for the postgres engine?
I was unable to locate one via the web site.
Thanks,
James
---(end of broadcast)---
TIP 1: subscribe and unsubscribe commands go to [EMAIL PROTECTED]
that the
developers would actually like.
I know this is a big ask, but once its done its done, and we can all get on
with the job. Not trying to criticize anyone, this is not a flame! Just
asking for a place for newbies to start hacking.
:-)
Appreciated very much.
--
James
PID PPID C STIME TTY TIME CMD
postgres 1842 1 0 12:41 ?00:00:00
/usr/local/pgsql/bin/postmaster -B 6000 -o -S 2000 -S -D
/usr/local/pgsql/data
postgres 1872 1842 82 12:41 ?01:06:20
/usr/local/pgsql/bin/postgres localhost nsadmin james INSERT
postgres 1997 1842
step in this direction.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 7: don't forget to increase your free space map settings
is flawed, then negative kudos to my puny mind.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 3: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to [EMAIL PROTECTED] so that your
On Jun 10, 2004, at 10:30 AM, [EMAIL PROTECTED] wrote:
Prior to lazy vacuum, this was impossible.
Do you know for sure that lazy vacuum and/or autovacuum does
not indeed solve / alleviate the symptoms of the general problem
of very high rate table updates?
Back to lurking!
James Robinson
in the
backend could be written , say, somewhere in the internals document
around the coding conventions chapter:
http://developer.postgresql.org/docs/postgres/source.html
I myself don't have a clue, not being a backend hacker, so I'll just
slink back to my cave.
James Robinson
Socialserve.com
implementation?
Quotas per user per tablespace, assuming 7.5 gets tablespaces.
User quotas would make postgres on a shared university box much more
pleasant.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 1: subscribe and unsubscribe
these instead of for update
locks.
How much work is involved in getting this done? Is interested in getting
paid to undertake this?
Please contact my email directly as I am not subscribed to this list.
James Pharaoh
---(end of broadcast)---
TIP 1
, t2, t3 cartesian product joined with t4.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 2: you can get off all lists at once with the unregister command
(send unregister YourEmailAddressHere to [EMAIL PROTECTED])
LOG: database system is ready
We were back online within minutes of the interruption w/o any data
loss.
So, I raise my glass to you! Thank you!
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 8: explain analyze is your friend
casts the literal int4 to an int8, making the int8
column index useable.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 3: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to [EMAIL
)
unit_zipcode_fkey FOREIGN KEY (zipcode) REFERENCES zipcode(id)
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 3: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to [EMAIL PROTECTED] so
Patch applied, fixes beta4 for the query with our data. Many thanks
again!
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 1: subscribe and unsubscribe commands go to [EMAIL PROTECTED]
of
transaction block
ERROR: current transaction is aborted, commands ignored until end of
transaction block
COMMIT
Many thanks in advance,
James
pets.sql
Description: Binary data
James Robinson
Socialserve.com
---(end of broadcast)---
TIP
.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 3: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to [EMAIL PROTECTED] so that your
message can get through to the mailing list cleanly
spellings of the keyword. This seems a
bit ugly but I can't think of any really good objections.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 3: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command
seemed to suit us just fine.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 8: explain analyze is your friend
fails as normal.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 5: don't forget to increase your free space map settings
a higher value for work_mem (10240, up from default of
1024). But the hourly crons went great for the subsequent two days.
maintenance_work_mem is still at the default of 16384.
Many thanks in advance!
James
James Robinson
Socialserve.com
---(end of broadcast
: postgres social [local] VACUUM waiting'
28861 -- production servicing backend, now back in idle state. [ not
in tx idle by regular idle ].
On Nov 28, 2005, at 11:09 AM, Tom Lane wrote:
James Robinson [EMAIL PROTECTED] writes:
Comparing the logs further with when it did complete, it seems that
one
0x08170de9 in PostmasterMain ()
#18 0x0813e5e5 in main ()
(gdb) quit
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 4: Have you searched our list archives?
http://archives.postgresql.org
to remote?
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 9: In versions below 8.0, the planner will ignore your desire to
choose an index scan if your joining column's datatypes do not
match
that additional buffering a damnable offense?
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 4: Have you searched our list archives?
http://archives.postgresql.org
On Nov 28, 2005, at 1:46 PM, Tom Lane wrote:
James Robinson [EMAIL PROTECTED] writes:
backtrace of the sshd doesn't look good:
Stripped executable :-( ... you won't get much info there. What of
the client at the far end of the ssh connection? You should probably
assume that the blockage
-wise?
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 1: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to [EMAIL PROTECTED] so that your
message can get through to the mailing list
savepoint handling and all.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 7: don't forget to increase your free space map settings
Markus Schaber wrote:
Ron wrote:
...and of course if you know enough about the data to be sorted so as to
constrain it appropriately, one should use a non comparison based O(N)
sorting algorithm rather than any of the general comparison based
O(NlgN) methods.
Sounds interesting, could you
I'm interested in poking though and taking a shot at getting my feet
wet with pl/python. I see the file is copyright Andrew Bosma -- is he
still around perhance? Is anyone currently the 'owner' ?
James Robinson
Socialserve.com
---(end of broadcast
see that plpython functions cannot be declared
to return void. That can't be too tough to remedy. Implementing the
DBI 2.0 API interface to SPI can wait another day.
On Feb 24, 2006, at 11:08 PM, Joshua D. Drake wrote:
James Robinson wrote:
I'm interested in poking though and taking a shot
I'm creating user-defined server extensions, written in C per the manual 31.9.
C-Language Functions. Everything works well, but only if I fully link the .so such
that there are *no* unresolved external references at all. Not even the stuff in
libstdc++.a can be left out. I've tried setting
Tom Lane wrote:
I'm creating user-defined server extensions, written in C per the
manual 31.9. C-Language Functions. Everything works well, but only
if I fully link the .so such that there are *no* unresolved external
references at all. Not even the stuff in libstdc++.a can be left out.
If
Peter Eisentraut wrote:
Unfortunately, we're also using a second library (OpenBabel) that is
written in C++. A good portion of the code I've written is a wrapper
layer that hides the C++ objects and presents a simple C wrapper that
works for Postgres.
I suggest if you want to get any concrete
figured I'd see if this is
specified in the spec, and hopefully induce a change if it isn't.
Thanks for you time,
James
btw, I'm not on the list(yet, perhaps), so please CC me.
---(end of broadcast)---
TIP 5: Have you checked our extensive FAQ
it, and
exit when the results are cat'd from the fifo.
Just wanted to make sure nothing similar enough was already in existence, and
if anyone could easily implement this. If no one wants to, I suppose I'll look into
doing it if it's worth doing. :)
Cheers,
James
pgp0.pgp
will come as well.
My version has a short ways to go before it is ready for usage, but if you
want to see what I've done, just drop me an e-mail.
Comments? Criticisms? Feature suggestions?
Anyone else doing significant work on plpython?
-James
pgp0.pgp
Description: PGP signature
optimization), but I thought I would check with the people
currently hacking on the system first, to see if there was a showstopper or
if someone is already working on this.
Cheers,
-James Rogers
[EMAIL PROTECTED]
---(end of broadcast)---
TIP 4
of
time-series data stored in a table, with each series keyed to another
table. The the typical tuple distribution creates pathological
behaviors when buffer space becomes tight.
Cheers,
-James Rogers
[EMAIL PROTECTED]
---(end of broadcast)---
TIP
. You could
always markup the index that CLUSTER uses to keep track of good
candidates (plus some additional structures), but the more I think about
that, the more it looks like a nasty hack.
Cheers,
-James Rogers
[EMAIL PROTECTED]
---(end of broadcast
On 10/2/03 11:34 PM, Hannu Krosing [EMAIL PROTECTED] wrote:
James Rogers kirjutas N, 02.10.2003 kell 23:44:
Not exactly. What you are describing is more akin to partitioning or
hash-organized tables i.e. sorting insert/update tuples to various pages
according to some hash function.
What I
tool in the tool belt.
Cheers,
-James Rogers
[EMAIL PROTECTED]
---(end of broadcast)---
TIP 8: explain analyze is your friend
questions:
1) Does anyone object to me working on these two areas?
2) What version target should I realistically be shooting for?
Cheers,
-James Rogers
[EMAIL PROTECTED]
---(end of broadcast)---
TIP 7: don't forget to increase your free space
{DarwinPortsDir}/dports/databases/postgresql/work/
.darwinports.postgresql.state
Remove the following lines:
target: com.apple.configure
Try the build of postgresql again, DO NOT clean it, just try the
install again.
-
Best of luck (was re: works for me.)
---
James
:
_PQfreemem
_PQresultErrorField
_PQsetNoticeReceiver
_last_path_separator
I noticed it's not linking with the -undefined suppress flag which
I've found it required when building 'bundles' for darwin.
Cheers,
On 12/10/2003, at 3:28 AM, Marko Karppinen wrote:
James, we've spent some time lately
, it is the difference between middling performance in the
typical case and highly optimal in just about every case. A database kernel
lets you use an operating system in the way it likes to be used rather than
using an API that you just happen to support.
Cheers,
-James Rogers
[EMAIL PROTECTED
On 10/14/03 11:31 PM, James Rogers [EMAIL PROTECTED] wrote:
There is some abstraction in Postgres and the database is well-written, but
it isn't written in a manner that makes it easy to swap out operating system
or API models. It is written to be portable at all levels. A database
kernel
-installed readline et.al. which are in /opt/local/lib and
/opt/local/include
Removing the old postgres libs would resolve this build issue, but
makes it a bit painful for users upgrading from an existing
installation.
On 15/10/2003, at 4:03 AM, Tom Lane wrote:
James Wilson [EMAIL PROTECTED] writes
of this particular beast.
Cheers,
-James Rogers
[EMAIL PROTECTED]
---(end of broadcast)---
TIP 3: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to [EMAIL PROTECTED] so that your
message can get
it
in production for anything. 6 + 7 could possibly be done atop mysql
using a 3-tier model.
James Robinson
Socialserve.com
---(end of broadcast)---
TIP 1: if posting/reading through Usenet, please send an appropriate
subscribe
things you can do in C, but most of them
are things I'd rather not do anyway.
Run such a build on the build farm each night, and it will be obvious as
soon as C++-unfriendly code sneaks in.
And who know, maybe eventually we could use C++ properly in the
code.
James
--
Sent via pgsql-hackers
On Nov 15, 2009, at 6:37 AM, Peter Eisentraut wrote:
but these two features don't excite me at all,
hrm.. at all?
I can see how function modules might look like a half-step backwards from
function fragments at first, but the benefits of a *natural* initialization
section (the module body)
On Nov 18, 2009, at 8:37 AM, Peter Eisentraut wrote:
The question is whether it helps the user, not the implementer.
Sure, but do you have a patch waiting to implement tracebacks?
I'd argue the reason it's never been done is due to the way procedures are
currently managed in PL/Python. And
On Nov 18, 2009, at 1:36 PM, James Pye wrote:
At this point, I'm not going to try getting it into PG. (apparent futility
and such)
ugh, on second thought, I think I've written a bit too much code to stop now.
I'm going to get plpython3 as far as I can and submit it to the next commitfest
On Nov 19, 2009, at 3:12 AM, Peter Eisentraut wrote:
The other approach, which is what James Pye's
new implementation proposes (as I understand it), is to convert
PostgreSQL types into specially made Python objects, such as
Postgres.types.record or Postgres.types.timestamp.
Convert
On Nov 19, 2009, at 11:32 AM, Peter Eisentraut wrote:
But you wouldn't, for example, get away with breaking SQL (or even
improving it incompatibly) to facilitate a better elog.
This doesn't fit the situation.
I'm not breaking PL/Python. I'm trying to add PL/Python3. =)
I think of a PL/Python
1 - 100 of 354 matches
Mail list logo
