RE: Rendering 12,000 pages
Jonathan: For a different purpose, we generate multiple PDFs in separate files and then merge them before delivery to the client. We use Apache pdfbox and so far it has been working like a dream. The only issue you will probably have is that it treats each PDF separately - you get a page break between each PDF and the page numbering restarts (for us this is OK since the user knows it is multiple reports packages into one file). I believe iText can re-paginate when you merge multiple files, btu I'm not sure about the page breaks or empty space between files. -Lou ~~ LOG-NET, Inc. The Logistics Network Management System ~~ 230 Half Mile Road Third Floor Red Bank, NJ 07701 PH: 732-758-6800 FAX: 732-747-7497 http://www.LOG-NET.com ~~ CONFIDENTIAL PRIVILEGED Unless otherwise indicated or if obvious from the nature of the content, the information contained herein is privileged and confidential information/work product. The communication is intended for the use of the individual or entity named above. If the reader of this transmission is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify the sender immediately by telephone (732-758-6800) or by electronic mail (postmas...@log-net.com), and destroy any copies, electronic, paper or otherwise, which you may have of this communication. Thank you. ~~ Jonathan Levinson jonathan.levin...@intersystems.com 03/01/2010 02:46 PM Please respond to fop-users@xmlgraphics.apache.org To fop-users@xmlgraphics.apache.org fop-users@xmlgraphics.apache.org cc Subject RE: Rendering 12,000 pages This is a good idea but the customer has been unwilling to split the job. They want to format 12,000 pages all at once. Thanks for your suggestion, which should prove valuable to other customers! Pdftk seems very useful! Best Regards, Jonathan Levinson -Original Message- From: Peter Hopfgartner [mailto:peter.hopfgart...@r3-gis.com] Sent: Monday, March 01, 2010 2:25 PM To: fop-users@xmlgraphics.apache.org Subject: Re: Rendering 12,000 pages Jonathan Levinson wrote: We have a customer who would like to format and print a 12,000 page document. If we have enough virtual memory on the machine can we give Java a large enough heap space to render to PDF a 12,000 page document? Best Regards, Jonathan Levinson Can you split the job? In a similar situation we print different sections and merge the pdf files afterwards with pdftk. Peter -- Dott. Peter Hopfgartner R3 GIS Srl - GmbH Via Johann Kravogl-Str. 2 I-39012 Meran/Merano (BZ) Email: peter.hopfgart...@r3-gis.com Tel. : +39 0473 494949 Fax : +39 0473 069902 www : http://www.r3-gis.com XING : http://www.xing.com/go/invita/8917535 - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org
RE: Rendering 12,000 pages
FYI, I ran the customer's sample data with FOP, and even though the data was complex involving nested sub-tables, on Red Hat Enterprise Linux with 64-bits, and 8 Gig of real memory (and 19 Gig of swap space), I was able to render a 3,415 page document. There was no table of contents or indices, no forward or back pointers. Essentially two pages were repeated over and over with different data from the XML file. So this might be an ideal case of printing something large. I am proposing to the customer that they split and recombine - given that their data is so repetitive. They aren't formatting a technical manual with every page having completely different content. They are filling in tables from repetitive data. Best Regards, Jonathan Levinson -Original Message- From: Miroslav Pukhalsky [mailto:miros...@dekasoft.com.ua] Sent: Tuesday, March 02, 2010 2:31 AM To: fop-users@xmlgraphics.apache.org Subject: Re: Rendering 12,000 pages Hello all, On 01.03.2010 22:33, Gregory Buchenberger wrote: I have a client that is creating up to 7,000 pages in a single page sequence. The PDF's also contain images. They are allowing about Xmx1500m for the JVM and it is working. It depends... I have a client that is creating only 750 pages with images. But FOP gets 8 Gigs RAM during build - too many cross-links, page numbers and a few TOCs. OS is Gentoo Linux. Job splitting is a good idea. You can make standalone application which makes a few small document parts and glues its after. Regards, Miroslav. - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org
Re: Rendering 12,000 pages
What's wrong with just trying it out and see what happens? If it fails after 50 pages the job needs to be split up. If it fails after 11,999 pages one can probably tweak it and get it work with 12,000 pages too StvB - Original Message From: Jonathan Levinson jonathan.levin...@intersystems.com To: fop-users@xmlgraphics.apache.org fop-users@xmlgraphics.apache.org Sent: Tue, March 2, 2010 2:58:49 PM Subject: RE: Rendering 12,000 pages FYI, I ran the customer's sample data with FOP, and even though the data was complex involving nested sub-tables, on Red Hat Enterprise Linux with 64-bits, and 8 Gig of real memory (and 19 Gig of swap space), I was able to render a 3,415 page document. There was no table of contents or indices, no forward or back pointers. Essentially two pages were repeated over and over with different data from the XML file. So this might be an ideal case of printing something large. I am proposing to the customer that they split and recombine - given that their data is so repetitive. They aren't formatting a technical manual with every page having completely different content. They are filling in tables from repetitive data. Best Regards, Jonathan Levinson -Original Message- From: Miroslav Pukhalsky [mailto:miros...@dekasoft.com.ua] Sent: Tuesday, March 02, 2010 2:31 AM To: fop-users@xmlgraphics.apache.org Subject: Re: Rendering 12,000 pages Hello all, On 01.03.2010 22:33, Gregory Buchenberger wrote: I have a client that is creating up to 7,000 pages in a single page sequence. The PDF's also contain images. They are allowing about Xmx1500m for the JVM and it is working. It depends... I have a client that is creating only 750 pages with images. But FOP gets 8 Gigs RAM during build - too many cross-links, page numbers and a few TOCs. OS is Gentoo Linux. Job splitting is a good idea. You can make standalone application which makes a few small document parts and glues its after. Regards, Miroslav. - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org
Re: Rendering 12,000 pages
Jonathan Levinson wrote: We have a customer who would like to format and print a 12,000 page document. If we have enough virtual memory on the machine can we give Java a large enough heap space to render to PDF a 12,000 page document? Best Regards, Jonathan Levinson Can you split the job? In a similar situation we print different sections and merge the pdf files afterwards with pdftk. Peter -- Dott. Peter Hopfgartner R3 GIS Srl - GmbH Via Johann Kravogl-Str. 2 I-39012 Meran/Merano (BZ) Email: peter.hopfgart...@r3-gis.com Tel. : +39 0473 494949 Fax : +39 0473 069902 www : http://www.r3-gis.com XING : http://www.xing.com/go/invita/8917535 - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org
RE: Rendering 12,000 pages
This is a good idea but the customer has been unwilling to split the job. They want to format 12,000 pages all at once. Thanks for your suggestion, which should prove valuable to other customers! Pdftk seems very useful! Best Regards, Jonathan Levinson -Original Message- From: Peter Hopfgartner [mailto:peter.hopfgart...@r3-gis.com] Sent: Monday, March 01, 2010 2:25 PM To: fop-users@xmlgraphics.apache.org Subject: Re: Rendering 12,000 pages Jonathan Levinson wrote: We have a customer who would like to format and print a 12,000 page document. If we have enough virtual memory on the machine can we give Java a large enough heap space to render to PDF a 12,000 page document? Best Regards, Jonathan Levinson Can you split the job? In a similar situation we print different sections and merge the pdf files afterwards with pdftk. Peter -- Dott. Peter Hopfgartner R3 GIS Srl - GmbH Via Johann Kravogl-Str. 2 I-39012 Meran/Merano (BZ) Email: peter.hopfgart...@r3-gis.com Tel. : +39 0473 494949 Fax : +39 0473 069902 www : http://www.r3-gis.com XING : http://www.xing.com/go/invita/8917535 - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org
Re: Rendering 12,000 pages
I have a client that is creating up to 7,000 pages in a single page sequence. The PDF's also contain images. They are allowing about Xmx1500m for the JVM and it is working. Gregory Buchenberger, CDIA+, ECMs Eightfold Consulting 15710 W. 3rd Place #4 Golden, CO 80401 720-259-7779 Office 720-299-2386 Mobile 877-713-5342 Fax www.eightfoldconsulting.com On Mon, Mar 1, 2010 at 1:29 PM, Stephan V Bechtolsheim svbechtolsh...@yahoo.com wrote: Are there any rules of thumb in terms of for 1000 pages you need about 3GB of virtual memory? The quoted number of '3GB' is random - I am just trying to make a point here in that I am asking whether anyone has a back of the envelope type of number? StVB - Original Message From: Jonathan Levinson jonathan.levin...@intersystems.com To: fop-users@xmlgraphics.apache.org fop-users@xmlgraphics.apache.org Sent: Mon, March 1, 2010 2:46:29 PM Subject: RE: Rendering 12,000 pages This is a good idea but the customer has been unwilling to split the job. They want to format 12,000 pages all at once. - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org
RE: Rendering 12,000 pages
Thanks this is very helpful! If you don't mind my asking - what OS are they on? How much RAM? 64-bit or 32-bit OS? Best Regards, Jonathan Levinson -Original Message- From: Gregory Buchenberger [mailto:gr...@eightfoldconsulting.com] Sent: Monday, March 01, 2010 3:34 PM To: fop-users@xmlgraphics.apache.org Subject: Re: Rendering 12,000 pages I have a client that is creating up to 7,000 pages in a single page sequence. The PDF's also contain images. They are allowing about Xmx1500m for the JVM and it is working. Gregory Buchenberger, CDIA+, ECMs Eightfold Consulting 15710 W. 3rd Place #4 Golden, CO 80401 720-259-7779 Office 720-299-2386 Mobile 877-713-5342 Fax www.eightfoldconsulting.com On Mon, Mar 1, 2010 at 1:29 PM, Stephan V Bechtolsheim svbechtolsh...@yahoo.com wrote: Are there any rules of thumb in terms of for 1000 pages you need about 3GB of virtual memory? The quoted number of '3GB' is random - I am just trying to make a point here in that I am asking whether anyone has a back of the envelope type of number? StVB - Original Message From: Jonathan Levinson jonathan.levin...@intersystems.com To: fop-users@xmlgraphics.apache.org fop-users@xmlgraphics.apache.org Sent: Mon, March 1, 2010 2:46:29 PM Subject: RE: Rendering 12,000 pages This is a good idea but the customer has been unwilling to split the job. They want to format 12,000 pages all at once. - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org
Re: Rendering 12,000 pages
They are running Windows Server 2008 in a VMware environment. I'm not sure how many GB of RAM they have alloted to the server. I do know that the Java VM is only alloted about 1.5 GB. Gregory Buchenberger, CDIA+, ECMs Eightfold Consulting 15710 W. 3rd Place #4 Golden, CO 80401 720-259-7779 Office 720-299-2386 Mobile 877-713-5342 Fax www.eightfoldconsulting.com On Mon, Mar 1, 2010 at 1:41 PM, Jonathan Levinson jonathan.levin...@intersystems.com wrote: Thanks this is very helpful! If you don't mind my asking - what OS are they on? How much RAM? 64-bit or 32-bit OS? Best Regards, Jonathan Levinson -Original Message- From: Gregory Buchenberger [mailto:gr...@eightfoldconsulting.com] Sent: Monday, March 01, 2010 3:34 PM To: fop-users@xmlgraphics.apache.org Subject: Re: Rendering 12,000 pages I have a client that is creating up to 7,000 pages in a single page sequence. The PDF's also contain images. They are allowing about Xmx1500m for the JVM and it is working. Gregory Buchenberger, CDIA+, ECMs Eightfold Consulting 15710 W. 3rd Place #4 Golden, CO 80401 720-259-7779 Office 720-299-2386 Mobile 877-713-5342 Fax www.eightfoldconsulting.com On Mon, Mar 1, 2010 at 1:29 PM, Stephan V Bechtolsheim svbechtolsh...@yahoo.com wrote: Are there any rules of thumb in terms of for 1000 pages you need about 3GB of virtual memory? The quoted number of '3GB' is random - I am just trying to make a point here in that I am asking whether anyone has a back of the envelope type of number? StVB - Original Message From: Jonathan Levinson jonathan.levin...@intersystems.com To: fop-users@xmlgraphics.apache.org fop-users@xmlgraphics.apache.org Sent: Mon, March 1, 2010 2:46:29 PM Subject: RE: Rendering 12,000 pages This is a good idea but the customer has been unwilling to split the job. They want to format 12,000 pages all at once. - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org
Re: Rendering 12,000 pages
I don't think the 64bit vs 32bit or *nix vs win makes a difference since the app is running in a 32bit Java VM. At least I would assume no difference. I think what really uses RAM is large continuous page sequences and big image files. Using smaller page sequences will result in better memory performance because (as I understand) FOP builds the page sequence in RAM before committing it to disk. Therefore, crafting XSL with more smaller page sequences uses less RAM overall. But my gut feeling is that approx 2GB of RAM alloted for the Java Virtual Machine should be more than enough for 12,000 pages barring images. Gregory Buchenberger, CDIA+, ECMs Eightfold Consulting 15710 W. 3rd Place #4 Golden, CO 80401 720-259-7779 Office 720-299-2386 Mobile 877-713-5342 Fax www.eightfoldconsulting.com On Mon, Mar 1, 2010 at 3:01 PM, Gregory Buchenberger gr...@eightfoldconsulting.com wrote: They are running Windows Server 2008 in a VMware environment. I'm not sure how many GB of RAM they have alloted to the server. I do know that the Java VM is only alloted about 1.5 GB. Gregory Buchenberger, CDIA+, ECMs Eightfold Consulting 15710 W. 3rd Place #4 Golden, CO 80401 720-259-7779 Office 720-299-2386 Mobile 877-713-5342 Fax www.eightfoldconsulting.com On Mon, Mar 1, 2010 at 1:41 PM, Jonathan Levinson jonathan.levin...@intersystems.com wrote: Thanks this is very helpful! If you don't mind my asking - what OS are they on? How much RAM? 64-bit or 32-bit OS? Best Regards, Jonathan Levinson -Original Message- From: Gregory Buchenberger [mailto:gr...@eightfoldconsulting.com] Sent: Monday, March 01, 2010 3:34 PM To: fop-users@xmlgraphics.apache.org Subject: Re: Rendering 12,000 pages I have a client that is creating up to 7,000 pages in a single page sequence. The PDF's also contain images. They are allowing about Xmx1500m for the JVM and it is working. Gregory Buchenberger, CDIA+, ECMs Eightfold Consulting 15710 W. 3rd Place #4 Golden, CO 80401 720-259-7779 Office 720-299-2386 Mobile 877-713-5342 Fax www.eightfoldconsulting.com On Mon, Mar 1, 2010 at 1:29 PM, Stephan V Bechtolsheim svbechtolsh...@yahoo.com wrote: Are there any rules of thumb in terms of for 1000 pages you need about 3GB of virtual memory? The quoted number of '3GB' is random - I am just trying to make a point here in that I am asking whether anyone has a back of the envelope type of number? StVB - Original Message From: Jonathan Levinson jonathan.levin...@intersystems.com To: fop-users@xmlgraphics.apache.org fop-users@xmlgraphics.apache.org Sent: Mon, March 1, 2010 2:46:29 PM Subject: RE: Rendering 12,000 pages This is a good idea but the customer has been unwilling to split the job. They want to format 12,000 pages all at once. - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org
Re: Rendering 12,000 pages
Hello all, On 01.03.2010 22:33, Gregory Buchenberger wrote: I have a client that is creating up to 7,000 pages in a single page sequence. The PDF's also contain images. They are allowing about Xmx1500m for the JVM and it is working. It depends... I have a client that is creating only 750 pages with images. But FOP gets 8 Gigs RAM during build - too many cross-links, page numbers and a few TOCs. OS is Gentoo Linux. Job splitting is a good idea. You can make standalone application which makes a few small document parts and glues its after. Regards, Miroslav. - To unsubscribe, e-mail: fop-users-unsubscr...@xmlgraphics.apache.org For additional commands, e-mail: fop-users-h...@xmlgraphics.apache.org
