Frame crashes when importing large XML file
Am 06.07.2009 um 11:25 schrieb Diane Gaskill: > Hi everyone, > > FM8, structured > XML, DocBook 4.2 (I know, I know. Not my idea, but an OEM customer > requires > it). > WinXP Pro > 4 GB RAM > 160 GB HDD I noticed memory leaks starting with FrameMaker 7.2. Memory was not released after opening XML files and if you opened a lot of XML files you run into trouble sooner or later. The problem was/is still there in FrameMaker 8. In a recent project with custom XML files (used to create ~250 page books with ~20 chapter files) FrameMaker 8 always crashed while opening the third book. The good news: FrameMaker 9.0.2 processed the exact same XML files without a problem, 21 books in a row. Maybe you can make a test with FrameMaker 9. - Michael -- ___ Michael M?ller-Hillebrand: Dokumentations-Technologie Adobe Certified Expert, FrameMaker L?sungen und Training, FrameScript, XML/XSL, Unicode Blog: http://cap-studio.de/ - Tel. +49 (9131) 28747
Re: Frame crashes when importing large XML file
Am 06.07.2009 um 11:25 schrieb Diane Gaskill: Hi everyone, FM8, structured XML, DocBook 4.2 (I know, I know. Not my idea, but an OEM customer requires it). WinXP Pro 4 GB RAM 160 GB HDD I noticed memory leaks starting with FrameMaker 7.2. Memory was not released after opening XML files and if you opened a lot of XML files you run into trouble sooner or later. The problem was/is still there in FrameMaker 8. In a recent project with custom XML files (used to create ~250 page books with ~20 chapter files) FrameMaker 8 always crashed while opening the third book. The good news: FrameMaker 9.0.2 processed the exact same XML files without a problem, 21 books in a row. Maybe you can make a test with FrameMaker 9. - Michael -- ___ Michael Müller-Hillebrand: Dokumentations-Technologie Adobe Certified Expert, FrameMaker Lösungen und Training, FrameScript, XML/XSL, Unicode Blog: http://cap-studio.de/ - Tel. +49 (9131) 28747 ___ You are currently subscribed to Framers as arch...@mail-archive.com. Send list messages to fram...@lists.frameusers.com. To unsubscribe send a blank email to framers-unsubscr...@lists.frameusers.com or visit http://lists.frameusers.com/mailman/options/framers/archive%40mail-archive.com Send administrative questions to listad...@frameusers.com. Visit http://www.frameusers.com/ for more resources and info.
Frame crashes when importing large XML file
Hi everyone, FM8, structured XML, DocBook 4.2 (I know, I know. Not my idea, but an OEM customer requires it). WinXP Pro 4 GB RAM 160 GB HDD We're trying to import an XML file into FM8 but FM crashes. The file includes 750 topics that are imported into an FM book as mini-chapter files. They will eventually become topics in RH via TCS. However, FM crashes at about 250 files (repeatable). Restarting FM and/or rebooting the system has no effect. We thought at first that there might be a limit on the number of chapters that can be added to a book. But the Adobe Tech Note at http://kb2.adobe.com/cps/310/310864.html says no, although there may be a practical limit that is dependent on RAM and disk space. TechNote Maximum Number of Files in an Adobe FrameMaker Book Ratings:0 FrameMaker does not limit the number of files you can place in a generated book. Adobe has tested placing several hundred files in a book without consequence. Though you can create a book of this size, generating or updating the book requires enough memory and disk space to open and save every file. I searched the net and the Adobe site but could not find any informatrion related to this problem. If anyone has any experience with this or knows of a tech note or other Adobe article that might provide an answer, I would really appreciate the help. Thanks lots. Diane Gaskill Hitachi Data Systems Santa Clara, CA ___ You are currently subscribed to Framers as arch...@mail-archive.com. Send list messages to fram...@lists.frameusers.com. To unsubscribe send a blank email to framers-unsubscr...@lists.frameusers.com or visit http://lists.frameusers.com/mailman/options/framers/archive%40mail-archive.com Send administrative questions to listad...@frameusers.com. Visit http://www.frameusers.com/ for more resources and info.
Re: Frame crashes when importing large XML file
Diane, I'm making a WAG that either you're hitting a processing wall (the RAM/disk space you mentioned -- how much of the 160 is free?), that there's a network timeout at a certain point, or that there's some type of content in the ~250 file range that's causing an error. Can you convert #250 by itself, or divide the project so that you can test, maybe by thirds? Topics 1-250, 251-500, and so on? Art Can you play with the configuration at all Art Campbell art.campb...@gmail.com ... In my opinion, there's nothing in this world beats a '52 Vincent and a redheaded girl. -- Richard Thompson No disclaimers apply. DoD 358 On Mon, Jul 6, 2009 at 5:25 AM, Diane Gaskilldgcal...@earthlink.net wrote: Hi everyone, FM8, structured XML, DocBook 4.2 (I know, I know. Not my idea, but an OEM customer requires it). WinXP Pro 4 GB RAM 160 GB HDD We're trying to import an XML file into FM8 but FM crashes. The file includes 750 topics that are imported into an FM book as mini-chapter files. They will eventually become topics in RH via TCS. However, FM crashes at about 250 files (repeatable). Restarting FM and/or rebooting the system has no effect. We thought at first that there might be a limit on the number of chapters that can be added to a book. But the Adobe Tech Note at http://kb2.adobe.com/cps/310/310864.html says no, although there may be a practical limit that is dependent on RAM and disk space. TechNote Maximum Number of Files in an Adobe FrameMaker Book Ratings:0 FrameMaker does not limit the number of files you can place in a generated book. Adobe has tested placing several hundred files in a book without consequence. Though you can create a book of this size, generating or updating the book requires enough memory and disk space to open and save every file. I searched the net and the Adobe site but could not find any informatrion related to this problem. If anyone has any experience with this or knows of a tech note or other Adobe article that might provide an answer, I would really appreciate the help. Thanks lots. Diane Gaskill Hitachi Data Systems Santa Clara, CA ___ You are currently subscribed to Framers as art.campb...@gmail.com. Send list messages to fram...@lists.frameusers.com. To unsubscribe send a blank email to framers-unsubscr...@lists.frameusers.com or visit http://lists.frameusers.com/mailman/options/framers/art.campbell%40gmail.com Send administrative questions to listad...@frameusers.com. Visit http://www.frameusers.com/ for more resources and info. ___ You are currently subscribed to Framers as arch...@mail-archive.com. Send list messages to fram...@lists.frameusers.com. To unsubscribe send a blank email to framers-unsubscr...@lists.frameusers.com or visit http://lists.frameusers.com/mailman/options/framers/archive%40mail-archive.com Send administrative questions to listad...@frameusers.com. Visit http://www.frameusers.com/ for more resources and info.
Re: Frame crashes when importing large XML file
On Mon, 6 Jul 2009 13:40:36 -0400, Art Campbell art.campb...@gmail.com wrote: or that there's some type of content in the ~250 file range that's causing an error. Adding to Art's thought, have you tried validating the file, to see if there is a well-formedness error or other such problem from which Frame can't recover? I do suspect you're pushing some internal limit here. The 250 is suspiciously close to 255... the max value of a byte, a limit a careless programmer could have imposed unknowingly, possibly in EDD processing. -- Jeremy H. Griffith, at Omni Systems Inc. jer...@omsys.com http://www.omsys.com/ ___ You are currently subscribed to Framers as arch...@mail-archive.com. Send list messages to fram...@lists.frameusers.com. To unsubscribe send a blank email to framers-unsubscr...@lists.frameusers.com or visit http://lists.frameusers.com/mailman/options/framers/archive%40mail-archive.com Send administrative questions to listad...@frameusers.com. Visit http://www.frameusers.com/ for more resources and info.
RE: Frame crashes when importing large XML file
Hi Jeremy, Excellent question. Yes, we validated the file with Oxygen before importing it into FM. Here is the procedure we are using. 1. Validate the XML in the Oxygen editor 2. Drag and drop the Validated XML file to the work area of FrameMaker 8. The Use Structured Application dialog box appears. 3. From the drop-down list, select Hitachi-RAID (EN), and then click Continue. (This uses a custom XSL file from our tools group) 4. An error message Validation of XML file failed. appears. We ignore the message and click OK to continue processing. The Save Book dialog box appears. 5.In the Save as type field, we select Book (*.book). Enter any file name and then click Save. Diane -Original Message- From: framers-boun...@lists.frameusers.com [mailto:framers-boun...@lists.frameusers.com]on Behalf Of Jeremy H. Griffith Sent: Monday, July 06, 2009 1:31 PM To: framers@lists.frameusers.com Subject: Re: Frame crashes when importing large XML file On Mon, 6 Jul 2009 13:40:36 -0400, Art Campbell art.campb...@gmail.com wrote: or that there's some type of content in the ~250 file range that's causing an error. Adding to Art's thought, have you tried validating the file, to see if there is a well-formedness error or other such problem from which Frame can't recover? I do suspect you're pushing some internal limit here. The 250 is suspiciously close to 255... the max value of a byte, a limit a careless programmer could have imposed unknowingly, possibly in EDD processing. -- Jeremy H. Griffith, at Omni Systems Inc. jer...@omsys.com http://www.omsys.com/ ___ You are currently subscribed to Framers as dgcal...@earthlink.net. Send list messages to fram...@lists.frameusers.com. To unsubscribe send a blank email to framers-unsubscr...@lists.frameusers.com or visit http://lists.frameusers.com/mailman/options/framers/dgcaller%40earthlink.net Send administrative questions to listad...@frameusers.com. Visit http://www.frameusers.com/ for more resources and info. ___ You are currently subscribed to Framers as arch...@mail-archive.com. Send list messages to fram...@lists.frameusers.com. To unsubscribe send a blank email to framers-unsubscr...@lists.frameusers.com or visit http://lists.frameusers.com/mailman/options/framers/archive%40mail-archive.com Send administrative questions to listad...@frameusers.com. Visit http://www.frameusers.com/ for more resources and info.
Re: Frame crashes when importing large XML file
On Mon, 6 Jul 2009 17:28:23 -0700, Diane Gaskill dgcal...@earthlink.net wrote: 3. From the drop-down list, select Hitachi-RAID (EN), and then click Continue. (This uses a custom XSL file from our tools group) 4. An error message Validation of XML file failed. appears. We ignore the message and click OK to continue processing. The Save Book dialog box appears. Then I'd say you've isolated it to a validation error introduced by the custom XSL. To check that, try using the DocBook EDD that comes out of the box with Frame, with no XSL. Any difference? -- Jeremy H. Griffith, at Omni Systems Inc. jer...@omsys.com http://www.omsys.com/ ___ You are currently subscribed to Framers as arch...@mail-archive.com. Send list messages to fram...@lists.frameusers.com. To unsubscribe send a blank email to framers-unsubscr...@lists.frameusers.com or visit http://lists.frameusers.com/mailman/options/framers/archive%40mail-archive.com Send administrative questions to listad...@frameusers.com. Visit http://www.frameusers.com/ for more resources and info.
RE: Frame crashes when importing large XML file
Jeremy and Alan, Good idea. We'll try that. I'll let you know what happens. We tried Scott Prentice' suggestion about splitting the file up. It works if we chop it up into sections of 90 topics each. But that's a lot of trouble. If it is actually a bug as Scott and Rick say, then the only way to get the file into FM is to break it up. But we have lots more files like this and manually breaking it up is probably not the most efficient way to do this. I'm hoping that Adobe Engineering finds/creates a real solution to the problem. Best regards, Diane = -Original Message- From: Jeremy H. Griffith [mailto:jer...@omsys.com] Sent: Monday, July 06, 2009 5:59 PM To: framers@lists.frameusers.com Cc: Diane Gaskill Subject: Re: Frame crashes when importing large XML file On Mon, 6 Jul 2009 17:28:23 -0700, Diane Gaskill dgcal...@earthlink.net wrote: 3. From the drop-down list, select Hitachi-RAID (EN), and then click Continue. (This uses a custom XSL file from our tools group) 4. An error message Validation of XML file failed. appears. We ignore the message and click OK to continue processing. The Save Book dialog box appears. Then I'd say you've isolated it to a validation error introduced by the custom XSL. To check that, try using the DocBook EDD that comes out of the box with Frame, with no XSL. Any difference? -- Jeremy H. Griffith, at Omni Systems Inc. jer...@omsys.com http://www.omsys.com/ ___ You are currently subscribed to Framers as arch...@mail-archive.com. Send list messages to fram...@lists.frameusers.com. To unsubscribe send a blank email to framers-unsubscr...@lists.frameusers.com or visit http://lists.frameusers.com/mailman/options/framers/archive%40mail-archive.com Send administrative questions to listad...@frameusers.com. Visit http://www.frameusers.com/ for more resources and info.
Frame crashes when importing large XML file
Hi everyone, FM8, structured XML, DocBook 4.2 (I know, I know. Not my idea, but an OEM customer requires it). WinXP Pro 4 GB RAM 160 GB HDD We're trying to import an XML file into FM8 but FM crashes. The file includes 750 topics that are imported into an FM book as mini-chapter files. They will eventually become topics in RH via TCS. However, FM crashes at about 250 files (repeatable). Restarting FM and/or rebooting the system has no effect. We thought at first that there might be a limit on the number of chapters that can be added to a book. But the Adobe Tech Note at http://kb2.adobe.com/cps/310/310864.html says no, although there may be a practical limit that is dependent on RAM and disk space. TechNote Maximum Number of Files in an Adobe FrameMaker Book Ratings:0 FrameMaker does not limit the number of files you can place in a generated book. Adobe has tested placing several hundred files in a book without consequence. Though you can create a book of this size, generating or updating the book requires enough memory and disk space to open and save every file. I searched the net and the Adobe site but could not find any informatrion related to this problem. If anyone has any experience with this or knows of a tech note or other Adobe article that might provide an answer, I would really appreciate the help. Thanks lots. Diane Gaskill Hitachi Data Systems Santa Clara, CA
Frame crashes when importing large XML file
Diane, I'm making a WAG that either you're hitting a processing wall (the RAM/disk space you mentioned -- how much of the 160 is free?), that there's a network timeout at a certain point, or that there's some type of content in the ~250 file range that's causing an error. Can you convert #250 by itself, or divide the project so that you can test, maybe by thirds? Topics 1-250, 251-500, and so on? Art Can you play with the configuration at all Art Campbell art.campbell at gmail.com "... In my opinion, there's nothing in this world beats a '52 Vincent and a redheaded girl." -- Richard Thompson No disclaimers apply. DoD 358 On Mon, Jul 6, 2009 at 5:25 AM, Diane Gaskill wrote: > Hi everyone, > > FM8, structured > XML, DocBook 4.2 ?(I know, I know. Not my idea, but an OEM customer requires > it). > WinXP Pro > 4 GB RAM > 160 GB HDD > > We're trying to import an XML file into FM8 but FM crashes. ?The file > includes 750 topics that are imported into an FM book as mini-chapter files. > They will eventually become topics in RH via TCS. ?However, FM crashes at > about 250 files (repeatable). ?Restarting FM and/or rebooting the system has > no effect. > > We thought at first that there might be a limit on the number of chapters > that can be added to a book. But the Adobe Tech Note at > http://kb2.adobe.com/cps/310/310864.html says no, although there may be a > practical limit that is dependent on RAM and disk space. > > ? ? ? ?TechNote > ? ? ? ?Maximum Number of Files in an Adobe FrameMaker Book > ? ? ? ?Ratings:0 > ? ? ? ?FrameMaker does not limit the number of files you can place in a > generated > book. > ? ? ? ?Adobe has tested placing several hundred files in a book without > consequence. > ? ? ? ?Though you can create a book of this size, generating or updating the > book > requires > ? ? ? ?enough memory and disk space to open and save every file. > > I searched the net and the Adobe site but could not find any informatrion > related to this problem. ?If anyone has any experience with this or knows of > a tech note or other Adobe article that might provide an answer, I would > really appreciate the help. > > Thanks lots. > > Diane Gaskill > Hitachi Data Systems > Santa Clara, CA > > > > > ___ > > > You are currently subscribed to Framers as art.campbell at gmail.com. > > Send list messages to framers at lists.frameusers.com. > > To unsubscribe send a blank email to > framers-unsubscribe at lists.frameusers.com > or visit > http://lists.frameusers.com/mailman/options/framers/art.campbell%40gmail.com > > Send administrative questions to listadmin at frameusers.com. Visit > http://www.frameusers.com/ for more resources and info. >
Frame crashes when importing large XML file
On Mon, 6 Jul 2009 13:40:36 -0400, Art Campbell wrote: >or that there's some type of content in the ~250 file >range that's causing an error. Adding to Art's thought, have you tried validating the file, to see if there is a well-formedness error or other such problem from which Frame can't recover? I do suspect you're pushing some internal limit here. The 250 is suspiciously close to 255... the max value of a byte, a limit a careless programmer could have imposed unknowingly, possibly in EDD processing. -- Jeremy H. Griffith, at Omni Systems Inc. http://www.omsys.com/
Frame crashes when importing large XML file
Hi Jeremy, Excellent question. Yes, we validated the file with Oxygen before importing it into FM. Here is the procedure we are using. 1. Validate the XML in the Oxygen editor 2. Drag and drop the Validated XML file to the work area of FrameMaker 8. The Use Structured Application dialog box appears. 3. From the drop-down list, select Hitachi-RAID (EN), and then click Continue. (This uses a custom XSL file from our tools group) 4. An error message "Validation of XML file failed." appears. We ignore the message and click OK to continue processing. The Save Book dialog box appears. 5.In the Save as type field, we select Book (*.book). Enter any file name and then click Save. Diane -Original Message- From: framers-boun...@lists.frameusers.com [mailto:framers-bounces at lists.frameusers.com]On Behalf Of Jeremy H. Griffith Sent: Monday, July 06, 2009 1:31 PM To: framers at lists.frameusers.com Subject: Re: Frame crashes when importing large XML file On Mon, 6 Jul 2009 13:40:36 -0400, Art Campbell wrote: >or that there's some type of content in the ~250 file >range that's causing an error. Adding to Art's thought, have you tried validating the file, to see if there is a well-formedness error or other such problem from which Frame can't recover? I do suspect you're pushing some internal limit here. The 250 is suspiciously close to 255... the max value of a byte, a limit a careless programmer could have imposed unknowingly, possibly in EDD processing. -- Jeremy H. Griffith, at Omni Systems Inc. http://www.omsys.com/ ___ You are currently subscribed to Framers as dgcaller at earthlink.net. Send list messages to framers at lists.frameusers.com. To unsubscribe send a blank email to framers-unsubscribe at lists.frameusers.com or visit http://lists.frameusers.com/mailman/options/framers/dgcaller%40earthlink.net Send administrative questions to listadmin at frameusers.com. Visit http://www.frameusers.com/ for more resources and info.
Frame crashes when importing large XML file
On Mon, 6 Jul 2009 17:28:23 -0700, "Diane Gaskill" wrote: >3. From the drop-down list, select Hitachi-RAID (EN), and then click >Continue. (This uses a custom XSL file from our tools group) > >4. An error message "Validation of XML file failed." appears. We ignore >the message and click OK to continue processing. The Save Book dialog box >appears. Then I'd say you've isolated it to a validation error introduced by the custom XSL. To check that, try using the DocBook EDD that comes out of the box with Frame, with no XSL. Any difference? -- Jeremy H. Griffith, at Omni Systems Inc. http://www.omsys.com/
Frame crashes when importing large XML file
Jeremy and Alan, Good idea. We'll try that. I'll let you know what happens. We tried Scott Prentice' suggestion about splitting the file up. It works if we chop it up into sections of 90 topics each. But that's a lot of trouble. If it is actually a bug as Scott and Rick say, then the only way to get the file into FM is to break it up. But we have lots more files like this and manually breaking it up is probably not the most efficient way to do this. I'm hoping that Adobe Engineering finds/creates a real solution to the problem. Best regards, Diane = -Original Message- From: Jeremy H. Griffith [mailto:jer...@omsys.com] Sent: Monday, July 06, 2009 5:59 PM To: framers at lists.frameusers.com Cc: Diane Gaskill Subject: Re: Frame crashes when importing large XML file On Mon, 6 Jul 2009 17:28:23 -0700, "Diane Gaskill" wrote: >3. From the drop-down list, select Hitachi-RAID (EN), and then click >Continue. (This uses a custom XSL file from our tools group) > >4. An error message "Validation of XML file failed." appears. We ignore >the message and click OK to continue processing. The Save Book dialog box >appears. Then I'd say you've isolated it to a validation error introduced by the custom XSL. To check that, try using the DocBook EDD that comes out of the box with Frame, with no XSL. Any difference? -- Jeremy H. Griffith, at Omni Systems Inc. http://www.omsys.com/
