Re: Limit on number of pages plucked? (Error code=514)

2003-10-08 Thread Steven Spadt
Nope--exact same result on the Solaris box.  We'll work on getting you the pages so 
you can run it yourselves.

Thanks,
Steve

>>>
We're analyzing the Solaris run now--I'll let you know today!

>>> "David A. Desrosiers" <[EMAIL PROTECTED]> 10/03/03 07:28AM >>>

> I know I'm not qualified to assess the meaning of that but, just in case
> it helps, since 16k = 16x1024 = 163840 and I count 25 or so 30k+ pages,
> if there actually are more like 48 or so, and we add that to our 16326
> number from below, we come out awfully close to 16k, a limit which would
> appear to me to be a system-based limitation?

Could this be some sort of arbitrary limitation on the number of
open files that XP itself can handle? This really needs to be tested on a
completely separate machine in your environment with the same content to
be sure.


d.


___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev


Re: Limit on number of pages plucked? (Error code=514)

2003-10-08 Thread Steven Spadt
We're analyzing the Solaris run now--I'll let you know today!

>>> "David A. Desrosiers" <[EMAIL PROTECTED]> 10/03/03 07:28AM >>>

> I know I'm not qualified to assess the meaning of that but, just in case
> it helps, since 16k = 16x1024 = 163840 and I count 25 or so 30k+ pages,
> if there actually are more like 48 or so, and we add that to our 16326
> number from below, we come out awfully close to 16k, a limit which would
> appear to me to be a system-based limitation?

Could this be some sort of arbitrary limitation on the number of
open files that XP itself can handle? This really needs to be tested on a
completely separate machine in your environment with the same content to
be sure.


d.


___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev


Re: Limit on number of pages plucked? (Error code=514)

2003-10-03 Thread Michael Nordstrom
On Fri, Oct 03, 2003, Michael Nordstrom wrote:
> I will run it in the debugger now and see if I can pinpoint the
> problem...

I've found the problem (and it was actually related to the use of
Int16 in the SearchDocument function:) We get an overflow in the
code that is used to optimize the search values. Changing it to 
use UInt16 instead of Int16 seems to have fixed the problem, but
I guess we should review the code to make sure that fix is enough
also in the long run...

/Mike

___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev


Re: Limit on number of pages plucked? (Error code=514)

2003-10-03 Thread Michael Nordstrom
On Tue, Sep 30, 2003, Steven Spadt wrote:
> The cutoff (after which the links, in the viewer generate the
> Error code=514 error) is at record 16326. 

I wrote a program that generated 16330 html files that each linked
to the next file (except the first file that also included a link
to 16325 (to make it easy for me to jump to the end:) I created a 
Plucker document (took a while:) and when I tried it on one of my
Palm devices it failed with the same exception. I will run it in
the debugger now and see if I can pinpoint the problem...

/Mike

___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev


Re: Limit on number of pages plucked? (Error code=514)

2003-10-03 Thread Michael Nordstrom
On Mon, Sep 29, 2003, Alexander R. Pruss wrote:
> It should handle 65000 pages or so,

Is that really true? The SearchRAMDocument still uses Int16 variables
for the record index which should limit the amount of records (pages.)

However, this is unrelated to the problem Steven has run into...

/Mike

___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev


Re: Limit on number of pages plucked? (Error code=514)

2003-10-03 Thread David A. Desrosiers

> I know I'm not qualified to assess the meaning of that but, just in case
> it helps, since 16k = 16x1024 = 163840 and I count 25 or so 30k+ pages,
> if there actually are more like 48 or so, and we add that to our 16326
> number from below, we come out awfully close to 16k, a limit which would
> appear to me to be a system-based limitation?

Could this be some sort of arbitrary limitation on the number of
open files that XP itself can handle? This really needs to be tested on a
completely separate machine in your environment with the same content to
be sure.


d.

___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev


Re: Limit on number of pages plucked? (Error code=514)

2003-10-03 Thread David A. Desrosiers

> Is there any other piece of data we could provide, other than shipping
> you an archive of all the pages we're trying to pluck (which would be
> difficult but not impossible, logistically)?

Can you just scramble the content in a non-reversible way, and
ship those pages instead? I understand your issues with the nature of the
content, but we (I specifically) would like to figure out what is going on
here with your Plucker session that causes it to fail.

> Also, we're in the process of ironing out some kinks that will allow us
> to run the whole process on a Solaris box instead of the XP box we've
> been using.  We'll let you know if we get any different results with
> that.

I can guarantee that you will. Plucker was designed on Linux and
Unix machines, and then ported over to Windows, not the reverse. It spent
a few years running perfectly find on POSIX systems before the first
release that worked on Windows (thanks to Dirk and Robert O'Connor).


d.

___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev


Re: Limit on number of pages plucked? (Error code=514)

2003-10-03 Thread Steven Spadt
The cutoff (after which the links, in the viewer generate the Error code=514 error) is 
at record 16326.  I know I'm not qualified to assess the meaning of that but, just in 
case it helps, since 16k = 16x1024 = 163840 and I count 25 or so 30k+ pages, if there 
actually are more like 48 or so, and we add that to our 16326 number from below, we 
come out awfully close to 16k, a limit which would appear to me to be a system-based 
limitation?  One other note, when we run the parser (Java Plucker Distiller 1.2), we 
run with the -Xmx1536m command line parameter.  1536m was the highest we could go, I 
believe, according to an error message we received when we tried to bump it higher.  
Is there something we can/should do with this parameter to allow for record 
collections that exceed 16k?

Thanks again for all of your help!

Steve


>>>
Our record #s only go up to 16,539, so that's not the issue.  Only 20 pages are 
greater than 30k, and not by much.  Any other ideas?  The only clue we have is that 
all of the pages that generate this error code (on load within the PalmOS viewer) are 
the last records being "plucked."  We're pinpointing the cutoff at which this occurs 
(the record number after which all plucked pages generate this error).  Is there any 
other piece of data we could provide, other than shipping you an archive of all the 
pages we're trying to pluck (which would be difficult but not impossible, 
logistically)?  Also, we're in the process of ironing out some kinks that will allow 
us to run the whole process on a Solaris box instead of the XP box we've been using.  
We'll let you know if we get any different results with that.

Thanks again for your help!

Steve


>>> Chris Hawks <[EMAIL PROTECTED]> 09/29/03 11:40AM >>>
---Reply to mail from Alexander R. Pruss about Limit on number of pages plucked? 
(Error code=514)

> It should handle 65000 pages or so, or at least 32000 (depending on whether
> a fix of mine is included in the 1.4 version or not).  The complication is
> that pages that are over 3 bytes long get split into multiple 3 byte
> pages.  Do you think this might have happened and pushed you over the limit?
> --

Steven:

If you set verbose to '3' ( '-V 3' ) on the command line, the last log
entries will show the record numbers. i.e

file:/var/spool/netcomics/dilbert20011201.gif?width=150&height=53&depth=4 =>  14
file:/var/spool/netcomics/dilbert20011201.gif?width=600&height=213&depth=4 =>  13
file:/var/spool/netcomics/popeye20011201.gif?width=525&height=154&depth=4 =>  25
file:/var/spool/netcomics/user_friendly20011201.gif?width=576&height=219&depth=4 =>  29

These are records 14, 13, 25, and 29. Let us know that the maximum
record number is. As Alex said, if the records are large, they will be
broken up into smaller records increasing the record numbers.

---End reply

Christopher R. Hawks
HAWKSoft
-
.. I used to get in more fights with SCO than I did my girlfriend, but 
now, thanks to Linux, she has more than happily accepted her place back at 
number one antagonist in my life.. 
-- Jason Stiefel, [EMAIL PROTECTED] 






___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev


Re: Limit on number of pages plucked? (Error code=514)

2003-10-03 Thread Steven Spadt
Our record #s only go up to 16,539, so that's not the issue.  Only 20 pages are 
greater than 30k, and not by much.  Any other ideas?  The only clue we have is that 
all of the pages that generate this error code (on load within the PalmOS viewer) are 
the last records being "plucked."  We're pinpointing the cutoff at which this occurs 
(the record number after which all plucked pages generate this error).  Is there any 
other piece of data we could provide, other than shipping you an archive of all the 
pages we're trying to pluck (which would be difficult but not impossible, 
logistically)?  Also, we're in the process of ironing out some kinks that will allow 
us to run the whole process on a Solaris box instead of the XP box we've been using.  
We'll let you know if we get any different results with that.

Thanks again for your help!

Steve


>>> Chris Hawks <[EMAIL PROTECTED]> 09/29/03 11:40AM >>>
---Reply to mail from Alexander R. Pruss about Limit on number of pages plucked? 
(Error code=514)

> It should handle 65000 pages or so, or at least 32000 (depending on whether
> a fix of mine is included in the 1.4 version or not).  The complication is
> that pages that are over 3 bytes long get split into multiple 3 byte
> pages.  Do you think this might have happened and pushed you over the limit?
> --

Steven:

If you set verbose to '3' ( '-V 3' ) on the command line, the last log
entries will show the record numbers. i.e

file:/var/spool/netcomics/dilbert20011201.gif?width=150&height=53&depth=4 =>  14
file:/var/spool/netcomics/dilbert20011201.gif?width=600&height=213&depth=4 =>  13
file:/var/spool/netcomics/popeye20011201.gif?width=525&height=154&depth=4 =>  25
file:/var/spool/netcomics/user_friendly20011201.gif?width=576&height=219&depth=4 =>  29

These are records 14, 13, 25, and 29. Let us know that the maximum
record number is. As Alex said, if the records are large, they will be
broken up into smaller records increasing the record numbers.

---End reply

Christopher R. Hawks
HAWKSoft
-
.. I used to get in more fights with SCO than I did my girlfriend, but 
now, thanks to Linux, she has more than happily accepted her place back at 
number one antagonist in my life.. 
-- Jason Stiefel, [EMAIL PROTECTED] 






___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev


Re: Limit on number of pages plucked? (Error code=514)

2003-10-03 Thread Steven Spadt
Thanks, yes this could be the problem.  Let me re-run and check the log as you 
suggest...

Steve

>>> Chris Hawks <[EMAIL PROTECTED]> 09/29/03 11:40AM >>>
---Reply to mail from Alexander R. Pruss about Limit on number of pages plucked? 
(Error code=514)

> It should handle 65000 pages or so, or at least 32000 (depending on whether
> a fix of mine is included in the 1.4 version or not).  The complication is
> that pages that are over 3 bytes long get split into multiple 3 byte
> pages.  Do you think this might have happened and pushed you over the limit?
> --

Steven:

If you set verbose to '3' ( '-V 3' ) on the command line, the last log
entries will show the record numbers. i.e

file:/var/spool/netcomics/dilbert20011201.gif?width=150&height=53&depth=4 =>  14
file:/var/spool/netcomics/dilbert20011201.gif?width=600&height=213&depth=4 =>  13
file:/var/spool/netcomics/popeye20011201.gif?width=525&height=154&depth=4 =>  25
file:/var/spool/netcomics/user_friendly20011201.gif?width=576&height=219&depth=4 =>  29

These are records 14, 13, 25, and 29. Let us know that the maximum
record number is. As Alex said, if the records are large, they will be
broken up into smaller records increasing the record numbers.

---End reply

Christopher R. Hawks
HAWKSoft
-
.. I used to get in more fights with SCO than I did my girlfriend, but 
now, thanks to Linux, she has more than happily accepted her place back at 
number one antagonist in my life.. 
-- Jason Stiefel, [EMAIL PROTECTED] 






___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev


JPluck from the command line (was: Limit on number of pages plucked? (Error code=514))

2003-09-29 Thread Michael Nordstrom
On Thu, Sep 25, 2003, Steven Spadt wrote:
> I'd love support for  and , but need a command-line
> interface, so JPluck isn't the answer.

You can run JPluck from the command line, too. For example to pluck
The Register site you could run the following,

$ java -jar convert.jar jxl/theregister.jxl

/Mike

___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev


Re: Limit on number of pages plucked? (Error code=514)

2003-09-29 Thread Chris Hawks
---Reply to mail from Alexander R. Pruss about Limit on number of pages plucked? 
(Error code=514)

> It should handle 65000 pages or so, or at least 32000 (depending on whether
> a fix of mine is included in the 1.4 version or not).  The complication is
> that pages that are over 3 bytes long get split into multiple 3 byte
> pages.  Do you think this might have happened and pushed you over the limit?
> --

Steven:

If you set verbose to '3' ( '-V 3' ) on the command line, the last log
entries will show the record numbers. i.e

file:/var/spool/netcomics/dilbert20011201.gif?width=150&height=53&depth=4 =>  14
file:/var/spool/netcomics/dilbert20011201.gif?width=600&height=213&depth=4 =>  13
file:/var/spool/netcomics/popeye20011201.gif?width=525&height=154&depth=4 =>  25
file:/var/spool/netcomics/user_friendly20011201.gif?width=576&height=219&depth=4 =>  29

These are records 14, 13, 25, and 29. Let us know that the maximum
record number is. As Alex said, if the records are large, they will be
broken up into smaller records increasing the record numbers.

---End reply

Christopher R. Hawks
HAWKSoft
-
.. I used to get in more fights with SCO than I did my girlfriend, but 
now, thanks to Linux, she has more than happily accepted her place back at 
number one antagonist in my life.. 
-- Jason Stiefel, [EMAIL PROTECTED]





___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev


Re: Limit on number of pages plucked? (Error code=514)

2003-09-29 Thread Alexander R. Pruss
It should handle 65000 pages or so, or at least 32000 (depending on whether
a fix of mine is included in the 1.4 version or not).  The complication is
that pages that are over 3 bytes long get split into multiple 3 byte
pages.  Do you think this might have happened and pushed you over the limit?
--
Dr. Alexander R. Pruss
Department of Philosophy
Georgetown University
Washington, DC 20057-1133  U.S.A.
e-mail: [EMAIL PROTECTED]
online papers and home page: www.georgetown.edu/faculty/ap85
--
   "Philosophiam discimus non ut tantum sciamus, sed ut boni efficiamur."
   - Paul of Worczyn (1424)

- Original Message - 
From: "Steven Spadt" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Thursday, September 25, 2003 11:31 AM
Subject: Limit on number of pages plucked? (Error code=514)


Hello all,

I'm getting an error code = 514 when I navigate to certain pages within a
pluckered pdb.  The PalmOS error code decoder shows that "Error 514
(decimal) is dmErrIndexOutOfRange, defined in DataMgr.h"  Also, all the
pages generating that error seem to be the last ones that were parsed/added
by the plucker distillation (according to the log file).  I'm using the
command-line Java Distiller 1.2 (not JPluck).  Our site is very large (the
number of files parsed is 16,492), so my question is, is it possible that
there is some limit in the number of pages plucked that would be causing
this error?  If so, would a modification to the distiller solve this or is
it a limitation in the PalmOS itself?

One more follow-up: any plans for a Java version of the 1.4 distiller?  I'd
love support for  and , but need a command-line interface, so
JPluck isn't the answer.

Thanks in advance for your help!

Steve


Steven Spadt
Director, Electronic Product Development
American College of Physicians
+ 215.351.2574
+ [EMAIL PROTECTED]

___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev

___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev


Limit on number of pages plucked? (Error code=514)

2003-09-29 Thread Steven Spadt
Hello all,

I'm getting an error code = 514 when I navigate to certain pages within a pluckered 
pdb.  The PalmOS error code decoder shows that "Error 514 (decimal) is 
dmErrIndexOutOfRange, defined in DataMgr.h"  Also, all the pages generating that error 
seem to be the last ones that were parsed/added by the plucker distillation (according 
to the log file).  I'm using the command-line Java Distiller 1.2 (not JPluck).  Our 
site is very large (the number of files parsed is 16,492), so my question is, is it 
possible that there is some limit in the number of pages plucked that would be causing 
this error?  If so, would a modification to the distiller solve this or is it a 
limitation in the PalmOS itself?

One more follow-up: any plans for a Java version of the 1.4 distiller?  I'd love 
support for  and , but need a command-line interface, so JPluck isn't the 
answer.

Thanks in advance for your help!

Steve


Steven Spadt
Director, Electronic Product Development
American College of Physicians
+ 215.351.2574
+ [EMAIL PROTECTED] 

___
plucker-dev mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-dev