Re: [HACKERS] pg_dump 2GB limit?

2002-03-29 Thread Jan Wieck

Christopher Kings-Lynne wrote:
   File size limit exceeded (core dumped)
  
   We suspect pg_dump.  Is this true?  Why would there be this limit in
   pg_dump?  Is it scheduled to be fixed?

 Try piping the output of pg_dump through bzip2 before writing it to disk.
 Or else, I think that pg_dump has -z or something parameters for turning
 on compression.

And if that isn't enough, you can pipe the output (compressed
or not) into split(1).


Jan

--

#==#
# It's easier to get forgiveness for being wrong than for being right. #
# Let's break this rule - forgive me.  #
#== [EMAIL PROTECTED] #



_
Do You Yahoo!?
Get your free @yahoo.com address at http://mail.yahoo.com


---(end of broadcast)---
TIP 4: Don't 'kill -9' the postmaster



[HACKERS] pg_dump 2GB limit?

2002-03-28 Thread Laurette Cisneros


The archives search is not working on postgresql.org so I need to ask this
question...

We are using postgresql 7.2 and when dumping one of our larger databases,
we get the following error:

File size limit exceeded (core dumped)

We suspect pg_dump.  Is this true?  Why would there be this limit in
pg_dump?  Is it scheduled to be fixed?

Thanks,

-- 
Laurette Cisneros
Database Roadie
(510) 420-3137
NextBus Information Systems, Inc.
www.nextbus.com
Where's my bus?



---(end of broadcast)---
TIP 3: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to [EMAIL PROTECTED] so that your
message can get through to the mailing list cleanly



Re: [HACKERS] pg_dump 2GB limit?

2002-03-28 Thread Doug McNaught

Laurette Cisneros [EMAIL PROTECTED] writes:

 The archives search is not working on postgresql.org so I need to ask this
 question...
 
 We are using postgresql 7.2 and when dumping one of our larger databases,
 we get the following error:
 
 File size limit exceeded (core dumped)
 
 We suspect pg_dump.  Is this true?  Why would there be this limit in
 pg_dump?  Is it scheduled to be fixed?

This means one of two things:

1) Your ulimits are set too low, or
2) Your pg_dump wasn't compiled against a C library with large file
   support (greater than 2GB).

Is this on Linux?

-Doug
-- 
Doug McNaught   Wireboard Industries  http://www.wireboard.com/

  Custom software development, systems and network consulting.
  Java PostgreSQL Enhydra Python Zope Perl Apache Linux BSD...

---(end of broadcast)---
TIP 3: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to [EMAIL PROTECTED] so that your
message can get through to the mailing list cleanly



Re: [HACKERS] pg_dump 2GB limit?

2002-03-28 Thread Peter Eisentraut

Laurette Cisneros writes:

 We are using postgresql 7.2 and when dumping one of our larger databases,
 we get the following error:

 File size limit exceeded (core dumped)

 We suspect pg_dump.  Is this true?

No, it's your operating sytem.

http://www.us.postgresql.org/users-lounge/docs/7.2/postgres/backup.html#BACKUP-DUMP-LARGE

-- 
Peter Eisentraut   [EMAIL PROTECTED]


---(end of broadcast)---
TIP 1: subscribe and unsubscribe commands go to [EMAIL PROTECTED]



Re: [HACKERS] pg_dump 2GB limit?

2002-03-28 Thread Laurette Cisneros

Hi,

I'm on Red Hat.  Here's the uname info:
Linux visor 2.4.2-2 #1 Sun Apr 8 20:41:30 EDT 2001 i686 unknown

What do I need to do to turn on large file support in the compile?

Thanks,

L.
On 28 Mar 2002, Doug McNaught wrote:

 Laurette Cisneros [EMAIL PROTECTED] writes:
 
  The archives search is not working on postgresql.org so I need to ask this
  question...
  
  We are using postgresql 7.2 and when dumping one of our larger databases,
  we get the following error:
  
  File size limit exceeded (core dumped)
  
  We suspect pg_dump.  Is this true?  Why would there be this limit in
  pg_dump?  Is it scheduled to be fixed?
 
 This means one of two things:
 
 1) Your ulimits are set too low, or
 2) Your pg_dump wasn't compiled against a C library with large file
support (greater than 2GB).
 
 Is this on Linux?
 
 -Doug
 

-- 
Laurette Cisneros
Database Roadie
(510) 420-3137
NextBus Information Systems, Inc.
www.nextbus.com
Where's my bus?


---(end of broadcast)---
TIP 5: Have you checked our extensive FAQ?

http://www.postgresql.org/users-lounge/docs/faq.html



Re: [HACKERS] pg_dump 2GB limit?

2002-03-28 Thread Doug McNaught

Laurette Cisneros [EMAIL PROTECTED] writes:

 Hi,
 
 I'm on Red Hat.  Here's the uname info:
 Linux visor 2.4.2-2 #1 Sun Apr 8 20:41:30 EDT 2001 i686 unknown

That's an old and buggy kernel, BTW--you should install the errata
upgrades, 

 What do I need to do to turn on large file support in the compile?

Make sure you are running the latest kernel and libs, and AFAIK
'configure' should set it up for you automatically.

-Doug
-- 
Doug McNaught   Wireboard Industries  http://www.wireboard.com/

  Custom software development, systems and network consulting.
  Java PostgreSQL Enhydra Python Zope Perl Apache Linux BSD...

---(end of broadcast)---
TIP 4: Don't 'kill -9' the postmaster



Re: [HACKERS] pg_dump 2GB limit?

2002-03-28 Thread Laurette Cisneros


Oops sent the wrong uname, here's the one from the machine we compiled on:
Linux lept 2.4.16 #6 SMP Fri Feb 8 13:31:46 PST 2002 i686 unknown

and has: libc-2.2.2.so 

We use ./configure 

Still a problem?

We do compress (-Fc) right now, but are working on a backup scheme that
requires and uncompressed dump.

Thanks for the help!

L.

On 28 Mar 2002, Doug McNaught wrote:

 Laurette Cisneros [EMAIL PROTECTED] writes:
 
  Hi,
  
  I'm on Red Hat.  Here's the uname info:
  Linux visor 2.4.2-2 #1 Sun Apr 8 20:41:30 EDT 2001 i686 unknown
 
 That's an old and buggy kernel, BTW--you should install the errata
 upgrades, 
 
  What do I need to do to turn on large file support in the compile?
 
 Make sure you are running the latest kernel and libs, and AFAIK
 'configure' should set it up for you automatically.
 
 -Doug
 

-- 
Laurette Cisneros
Database Roadie
(510) 420-3137
NextBus Information Systems, Inc.
www.nextbus.com
Where's my bus?


---(end of broadcast)---
TIP 6: Have you searched our list archives?

http://archives.postgresql.org



Re: [HACKERS] pg_dump 2GB limit?

2002-03-28 Thread Trond Eivind Glomsrød

Laurette Cisneros [EMAIL PROTECTED] writes:

 Hi,
 
 I'm on Red Hat.  Here's the uname info:
 Linux visor 2.4.2-2 #1 Sun Apr 8 20:41:30 EDT 2001 i686 unknown

You should really upgrade (kernel and the rest), but this kernel
supports large files.

-- 
Trond Eivind Glomsrød
Red Hat, Inc.

---(end of broadcast)---
TIP 6: Have you searched our list archives?

http://archives.postgresql.org



Re: [HACKERS] pg_dump 2GB limit?

2002-03-28 Thread Trond Eivind Glomsrød

Peter Eisentraut [EMAIL PROTECTED] writes:

 Laurette Cisneros writes:
 
  We are using postgresql 7.2 and when dumping one of our larger databases,
  we get the following error:
 
  File size limit exceeded (core dumped)
 
  We suspect pg_dump.  Is this true?
 
 No, it's your operating sytem.

Red Hat Linux 7.x which he seems to be using supports this.
-- 
Trond Eivind Glomsrød
Red Hat, Inc.

---(end of broadcast)---
TIP 6: Have you searched our list archives?

http://archives.postgresql.org



Re: [HACKERS] pg_dump 2GB limit?

2002-03-28 Thread Christopher Kings-Lynne

  File size limit exceeded (core dumped)
 
  We suspect pg_dump.  Is this true?  Why would there be this limit in
  pg_dump?  Is it scheduled to be fixed?

Try piping the output of pg_dump through bzip2 before writing it to disk.
Or else, I think that pg_dump has -z or something parameters for turning
on compression.

Chris



---(end of broadcast)---
TIP 4: Don't 'kill -9' the postmaster