Re: Image Export Issues

[Douglas von Roeder via 4D_Tech]

Robert:

Agreed. My condolences, Robert.

--
Douglas von Roeder
949-910-4084


On Fri, Apr 3, 2020 at 6:29 AM Cannon Smith via 4D_Tech <
4d_tech@lists.4d.com> wrote:

> So sorry to hear about your wife, Robert. I can’t imagine how tough that
> is for you.
>
> --
> Cannon Smith
>
> > On Apr 2, 2020, at 10:56 PM, Robert McKeever via 4D_Tech <
> 4d_tech@lists.4d.com> wrote:
> >
> > So, to all, thank you. I needed a success - my wife of almost 39 years
> passed away from a long battle (10 years or more) with Vascular Dementia.
> My soulmate.
>
> **
> 4D Internet Users Group (4D iNUG)
> Archive:  http://lists.4d.com/archives.html
> Options: https://lists.4d.com/mailman/options/4d_tech
> Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
> **
**
4D Internet Users Group (4D iNUG)
Archive:  http://lists.4d.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
**

Re: Image Export Issues

[Cannon Smith via 4D_Tech]

So sorry to hear about your wife, Robert. I can’t imagine how tough that is for 
you. 

--
Cannon Smith

> On Apr 2, 2020, at 10:56 PM, Robert McKeever via 4D_Tech 
> <4d_tech@lists.4d.com> wrote:
> 
> So, to all, thank you. I needed a success - my wife of almost 39 years passed 
> away from a long battle (10 years or more) with Vascular Dementia. My 
> soulmate.

**
4D Internet Users Group (4D iNUG)
Archive:  http://lists.4d.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
**

Re: Image Export Issues

[Chip Scheide via 4D_Tech]

to better mange the files you should (have)created a bunch of folders.
alphabetically, or every 1000 images, or whatever criteria make(ed) sense.

> OK. I applied this technique, along with WRITE PICTURE FILE. A single 
> pass for all images took about 3 hours (about 1/3 the time it took 
> before it would crash), and completely successful. I’m just waiting 
> on finder to display the list of 151,814 image files. It does take 
> awhile. 114.58Gb worth - previous versions of the extract using blobs 
> ended up well over 1,2Tb.
> 
> So, to all, thank you. I needed a success - my wife of almost 39 
> years passed away from a long battle (10 years or more) with Vascular 
> Dementia. My soulmate.
> 
>> On Apr 2, 2020, at 9:25 AM, Chuck Miller via 4D_Tech 
>> <4d_tech@lists.4d.com> wrote:
>> 
>> Remember why was stated. Launch a process. Do something like this
>> $CurrentNumber_L:=start
>> repeat
>> 
>> Launch new process($CurrentNumber_L)
>> wait til  new process completes
>> $CurrentNumber_L:=$CurrentNumber_L+50
>> 
>> 
>> 
>> until (end)
>> 
>> The new process will export 50 pictures_
>> 
>> This method probably will clear memory issues when new process ends
>> 
>> Regards
>> 
>> 
>> Chuck
>> 
>> Chuck Miller Voice: (617) 739-0306
>> Informed Solutions, Inc. Fax: (617) 232-1064   
>> mailto:cjmillerinformed-solutions.com 
>> Brookline, MA 02446 USA Registered 4D Developer
>>   Providers of 4D and Sybase connectivity
>>  http://www.informed-solutions.com  
>> 
>> This message and any attached documents contain information which 
>> may be confidential, subject to privilege or exempt from disclosure 
>> under applicable law.  These materials are intended only for the use 
>> of the intended recipient. If you are not the intended recipient of 
>> this transmission, you are hereby notified that any distribution, 
>> disclosure, printing, copying, storage, modification or the taking 
>> of any action in reliance upon this transmission is strictly 
>> prohibited.  Delivery of this message to any person other than the 
>> intended recipient shall not compromise or waive such 
>> confidentiality, privilege or exemption from disclosure as to this 
>> communication. 
>> 
>>> On Apr 2, 2020, at 11:54 AM, Robert McKeever via 4D_Tech 
>>> <4d_tech@lists.4d.com> wrote:
>>> 
>>> So, I modified the code to use WRITE PICTURE FILE. Nice. Runs much 
>>> faster. It did quit late last night. And again this morning when I 
>>> was also reading email, this time with a system crash message - 
>>> unable to grow buffer.
>>> 
>>> Once I finish with email, and the web, I’ll restart the machine and 
>>> restart the export from where it left off. It is having its 
>>> problems when it goes to export a series of 40Mb retinal scans.
>> 
>> **
>> 4D Internet Users Group (4D iNUG)
>> Archive:  http://lists.4d.com/archives.html
>> Options: https://lists.4d.com/mailman/options/4d_tech
>> Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
>> **
> 
> _
> Bob McKeever  http://www.mswl.com 
> McKeever's Software Wizardry
> Port Coquitlam, B.C.
> bobmckee...@mac.com
> 
> 
> 
> 
> **
> 4D Internet Users Group (4D iNUG)
> Archive:  http://lists.4d.com/archives.html
> Options: https://lists.4d.com/mailman/options/4d_tech
> Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
> **

Hell is other people 
 Jean-Paul Sartre
**
4D Internet Users Group (4D iNUG)
Archive:  http://lists.4d.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
**

Re: Image Export Issues

[Robert McKeever via 4D_Tech]

OK. I applied this technique, along with WRITE PICTURE FILE. A single pass for 
all images took about 3 hours (about 1/3 the time it took before it would 
crash), and completely successful. I’m just waiting on finder to display the 
list of 151,814 image files. It does take awhile. 114.58Gb worth - previous 
versions of the extract using blobs ended up well over 1,2Tb.

So, to all, thank you. I needed a success - my wife of almost 39 years passed 
away from a long battle (10 years or more) with Vascular Dementia. My soulmate.

> On Apr 2, 2020, at 9:25 AM, Chuck Miller via 4D_Tech <4d_tech@lists.4d.com> 
> wrote:
> 
> Remember why was stated. Launch a process. Do something like this
> $CurrentNumber_L:=start
> repeat
> 
> Launch new process($CurrentNumber_L)
> wait til  new process completes
> $CurrentNumber_L:=$CurrentNumber_L+50
> 
> 
> 
> until (end)
> 
> The new process will export 50 pictures_
> 
> This method probably will clear memory issues when new process ends
> 
> Regards
> 
> 
> Chuck
> 
> Chuck Miller Voice: (617) 739-0306
> Informed Solutions, Inc. Fax: (617) 232-1064   
> mailto:cjmillerinformed-solutions.com 
> Brookline, MA 02446 USA Registered 4D Developer
>   Providers of 4D and Sybase connectivity
>  http://www.informed-solutions.com  
> 
> This message and any attached documents contain information which may be 
> confidential, subject to privilege or exempt from disclosure under applicable 
> law.  These materials are intended only for the use of the intended 
> recipient. If you are not the intended recipient of this transmission, you 
> are hereby notified that any distribution, disclosure, printing, copying, 
> storage, modification or the taking of any action in reliance upon this 
> transmission is strictly prohibited.  Delivery of this message to any person 
> other than the intended recipient shall not compromise or waive such 
> confidentiality, privilege or exemption from disclosure as to this 
> communication. 
> 
>> On Apr 2, 2020, at 11:54 AM, Robert McKeever via 4D_Tech 
>> <4d_tech@lists.4d.com> wrote:
>> 
>> So, I modified the code to use WRITE PICTURE FILE. Nice. Runs much faster. 
>> It did quit late last night. And again this morning when I was also reading 
>> email, this time with a system crash message - unable to grow buffer.
>> 
>> Once I finish with email, and the web, I’ll restart the machine and restart 
>> the export from where it left off. It is having its problems when it goes to 
>> export a series of 40Mb retinal scans.
> 
> **
> 4D Internet Users Group (4D iNUG)
> Archive:  http://lists.4d.com/archives.html
> Options: https://lists.4d.com/mailman/options/4d_tech
> Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
> **

_
Bob McKeever  http://www.mswl.com 
McKeever's Software Wizardry
Port Coquitlam, B.C.
bobmckee...@mac.com




**
4D Internet Users Group (4D iNUG)
Archive:  http://lists.4d.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
**

Re: Image Export Issues

[Chuck Miller via 4D_Tech]

Remember why was stated. Launch a process. Do something like this
$CurrentNumber_L:=start
repeat

Launch new process($CurrentNumber_L)
wait til  new process completes
$CurrentNumber_L:=$CurrentNumber_L+50



until (end)

The new process will export 50 pictures_

This method probably will clear memory issues when new process ends

Regards


Chuck

 Chuck Miller Voice: (617) 739-0306
 Informed Solutions, Inc. Fax: (617) 232-1064   
 mailto:cjmillerinformed-solutions.com 
 Brookline, MA 02446 USA Registered 4D Developer
   Providers of 4D and Sybase connectivity
  http://www.informed-solutions.com  

This message and any attached documents contain information which may be 
confidential, subject to privilege or exempt from disclosure under applicable 
law.  These materials are intended only for the use of the intended recipient. 
If you are not the intended recipient of this transmission, you are hereby 
notified that any distribution, disclosure, printing, copying, storage, 
modification or the taking of any action in reliance upon this transmission is 
strictly prohibited.  Delivery of this message to any person other than the 
intended recipient shall not compromise or waive such confidentiality, 
privilege or exemption from disclosure as to this communication. 

> On Apr 2, 2020, at 11:54 AM, Robert McKeever via 4D_Tech 
> <4d_tech@lists.4d.com> wrote:
> 
> So, I modified the code to use WRITE PICTURE FILE. Nice. Runs much faster. It 
> did quit late last night. And again this morning when I was also reading 
> email, this time with a system crash message - unable to grow buffer.
> 
> Once I finish with email, and the web, I’ll restart the machine and restart 
> the export from where it left off. It is having its problems when it goes to 
> export a series of 40Mb retinal scans.

**
4D Internet Users Group (4D iNUG)
Archive:  http://lists.4d.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
**

Re: Image Export Issues

[Robert McKeever via 4D_Tech]

So, I modified the code to use WRITE PICTURE FILE. Nice. Runs much faster. It 
did quit late last night. And again this morning when I was also reading email, 
this time with a system crash message - unable to grow buffer.

Once I finish with email, and the web, I’ll restart the machine and restart the 
export from where it left off. It is having its problems when it goes to export 
a series of 40Mb retinal scans.

> On Apr 1, 2020, at 5:51 PM, Keisuke Miyako via 4D_Tech <4d_tech@lists.4d.com> 
> wrote:
> 
> only speculating,  but maybe the intense creation of BLOBs is saturating or 
> fragmenting the 32-bit cache management of v15.
> 
> it seems like you don't really need to use a BLOB, you could simply call 
> WRITE PICTURE FILE
> https://doc.4d.com/4Dv15/4D/15.6/WRITE-PICTURE-FILE.301-3818335.en.html
> 
> since you are on Mac, you could monitor the memory usage of 4D with Activity 
> Monitor.
> I suspect it keeps on growing until a crash near 4GB.
> 
> perhaps you could launch a new process and export a few hundred records at a 
> time.
> every time the process dies, maybe you would see that the memory usage 
> returns to normal.
> 
>> 2020/04/01 12:19、Robert McKeever via 4D_Tech <4d_tech@lists.4d.com>のメール:
>> 
>> If (([ScannedDocuments]FileType="JPEG") | ([ScannedDocuments]FileType="JPG"))
>> PICTURE TO BLOB([ScannedDocuments]FullImage;$MyBlob;".jpg")
>> Else 
>> PICTURE TO BLOB([ScannedDocuments]FullImage;$MyBlob;".bmp")
>> End if 
>> BLOB TO DOCUMENT(document;$MyBlob)
> 
> **
> 4D Internet Users Group (4D iNUG)
> Archive:  http://lists.4d.com/archives.html
> Options: https://lists.4d.com/mailman/options/4d_tech
> Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
> **

_
Bob McKeever  http://www.mswl.com 
McKeever's Software Wizardry
Port Coquitlam, B.C.
bobmckee...@mac.com




**
4D Internet Users Group (4D iNUG)
Archive:  http://lists.4d.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
**

Re: Image Export Issues

[Keisuke Miyako via 4D_Tech]

only speculating,  but maybe the intense creation of BLOBs is saturating or 
fragmenting the 32-bit cache management of v15.

it seems like you don't really need to use a BLOB, you could simply call WRITE 
PICTURE FILE
https://doc.4d.com/4Dv15/4D/15.6/WRITE-PICTURE-FILE.301-3818335.en.html

since you are on Mac, you could monitor the memory usage of 4D with Activity 
Monitor.
I suspect it keeps on growing until a crash near 4GB.

perhaps you could launch a new process and export a few hundred records at a 
time.
every time the process dies, maybe you would see that the memory usage returns 
to normal.

> 2020/04/01 12:19、Robert McKeever via 4D_Tech <4d_tech@lists.4d.com>のメール:
> 
> If (([ScannedDocuments]FileType="JPEG") | ([ScannedDocuments]FileType="JPG"))
> PICTURE TO BLOB([ScannedDocuments]FullImage;$MyBlob;".jpg")
> Else 
> PICTURE TO BLOB([ScannedDocuments]FullImage;$MyBlob;".bmp")
> End if 
> BLOB TO DOCUMENT(document;$MyBlob)

**
4D Internet Users Group (4D iNUG)
Archive:  http://lists.4d.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
**

Re: Image Export Issues

[Chuck Miller via 4D_Tech]

Do you have vmware or parallels. If not both are reasonably priced. If so you 
can create a leopard server to 10.12 version to run inside I am having no 
problems using 15 in this manner

Regards

Chuck

 Chuck Miller Voice: (617) 739-0306
 Informed Solutions, Inc. Fax: (617) 232-1064   
 mailto:cjmillerinformed-solutions.com 
 Brookline, MA 02446 USA Registered 4D Developer
   Providers of 4D and Sybase connectivity
  http://www.informed-solutions.com  

This message and any attached documents contain information which may be 
confidential, subject to privilege or exempt from disclosure under applicable 
law.  These materials are intended only for the use of the intended recipient. 
If you are not the intended recipient of this transmission, you are hereby 
notified that any distribution, disclosure, printing, copying, storage, 
modification or the taking of any action in reliance upon this transmission is 
strictly prohibited.  Delivery of this message to any person other than the 
intended recipient shall not compromise or waive such confidentiality, 
privilege or exemption from disclosure as to this communication. 

> On Apr 1, 2020, at 11:22 AM, Robert McKeever via 4D_Tech 
> <4d_tech@lists.4d.com> wrote:
> 
> I have a Mini with 10.11.6, and my ancient 17” MacBook Pro at 10.6.8 (the 
> only machine left that will run 4D V11). Bit of a pain to get the drive setup 
> on the Mini - I have to find a Thunderbolt 2 cable (I have the adaptor for it 
> for Thunderbolt 3). 
> 
> Yes, all documents are created as part of the code. Each picture is in a 
> picture field within the database, and that record also carries the picture 
> type - either JPEG or BMP.
> 
> I think it is memory allocation/recovery as well - 4D needs some time to do 
> its stuff. The IDLE command, which I have used to good effect on compiled, 
> server side processes, but since it is stand-alone, interpreted, it is not 
> applicable. maybe DELAY PROCESS. I’ll tinker with it.
> 
> All the images have non-zero size. I can view them within 4D. Extracting them 
> is getting frustrating.

**
4D Internet Users Group (4D iNUG)
Archive:  http://lists.4d.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
**

Re: Image Export Issues

[Robert McKeever via 4D_Tech]

I have a Mini with 10.11.6, and my ancient 17” MacBook Pro at 10.6.8 (the only 
machine left that will run 4D V11). Bit of a pain to get the drive setup on the 
Mini - I have to find a Thunderbolt 2 cable (I have the adaptor for it for 
Thunderbolt 3). 

Yes, all documents are created as part of the code. Each picture is in a 
picture field within the database, and that record also carries the picture 
type - either JPEG or BMP.

I think it is memory allocation/recovery as well - 4D needs some time to do its 
stuff. The IDLE command, which I have used to good effect on compiled, server 
side processes, but since it is stand-alone, interpreted, it is not applicable. 
maybe DELAY PROCESS. I’ll tinker with it.

All the images have non-zero size. I can view them within 4D. Extracting them 
is getting frustrating.

> On Apr 1, 2020, at 6:26 AM, Chuck Miller via 4D_Tech <4d_tech@lists.4d.com> 
> wrote:
> 
> One I would at list upgrade to 15.6
> 
> Two I would try using an older O/S I would bet 15 does not run well on 
> version you listed. I use 10.12 in a VM
> 
> Three I would bet it is a memory issue
> 
> Why are you using the document command. Have you created the document first.
> 
> I assume each picture is in it’s own document. If so I think you can just 
> pass the path in and not use Document. You would have HD:folder:Filename.jpg 
> or whatever
> 
> I might also test file size and if 0 skip it. I wrote code to export many 
> more pictures than that and found I had to do it in stages. We also had to 
> convert image types as our data was old. If you want I can send you that code 
> privately (If I can find it)
> 
> 
> 
> Regards
> 
> 
> Chuck
> 
> 
> Chuck Miller Voice: (617) 739-0306
> Informed Solutions, Inc. Fax: (617) 232-1064   
> mailto:cjmillerinformed-solutions.com 
> Brookline, MA 02446 USA Registered 4D Developer
>   Providers of 4D and Sybase connectivity
>  http://www.informed-solutions.com  
> 
> This message and any attached documents contain information which may be 
> confidential, subject to privilege or exempt from disclosure under applicable 
> law.  These materials are intended only for the use of the intended 
> recipient. If you are not the intended recipient of this transmission, you 
> are hereby notified that any distribution, disclosure, printing, copying, 
> storage, modification or the taking of any action in reliance upon this 
> transmission is strictly prohibited.  Delivery of this message to any person 
> other than the intended recipient shall not compromise or waive such 
> confidentiality, privilege or exemption from disclosure as to this 
> communication. 
> 
>> On Mar 31, 2020, at 11:19 PM, Robert McKeever via 4D_Tech 
>> <4d_tech@lists.4d.com> wrote:
>> 
>> The database is 4D v15.4, iMac 10.14.6, using a Pegasus 9Tb RAID (sweet 
>> drive).
> 
> **
> 4D Internet Users Group (4D iNUG)
> Archive:  http://lists.4d.com/archives.html
> Options: https://lists.4d.com/mailman/options/4d_tech
> Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
> **

_
Bob McKeever  http://www.mswl.com 
McKeever's Software Wizardry
Port Coquitlam, B.C.
bobmckee...@mac.com




**
4D Internet Users Group (4D iNUG)
Archive:  http://lists.4d.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
**

Re: Image Export Issues

[Chuck Miller via 4D_Tech]

One I would at list upgrade to 15.6

Two I would try using an older O/S I would bet 15 does not run well on version 
you listed. I use 10.12 in a VM

Three I would bet it is a memory issue

Why are you using the document command. Have you created the document first.

I assume each picture is in it’s own document. If so I think you can just pass 
the path in and not use Document. You would have HD:folder:Filename.jpg or 
whatever

I might also test file size and if 0 skip it. I wrote code to export many more 
pictures than that and found I had to do it in stages. We also had to convert 
image types as our data was old. If you want I can send you that code privately 
(If I can find it)



Regards


Chuck


 Chuck Miller Voice: (617) 739-0306
 Informed Solutions, Inc. Fax: (617) 232-1064   
 mailto:cjmillerinformed-solutions.com 
 Brookline, MA 02446 USA Registered 4D Developer
   Providers of 4D and Sybase connectivity
  http://www.informed-solutions.com  

This message and any attached documents contain information which may be 
confidential, subject to privilege or exempt from disclosure under applicable 
law.  These materials are intended only for the use of the intended recipient. 
If you are not the intended recipient of this transmission, you are hereby 
notified that any distribution, disclosure, printing, copying, storage, 
modification or the taking of any action in reliance upon this transmission is 
strictly prohibited.  Delivery of this message to any person other than the 
intended recipient shall not compromise or waive such confidentiality, 
privilege or exemption from disclosure as to this communication. 

> On Mar 31, 2020, at 11:19 PM, Robert McKeever via 4D_Tech 
> <4d_tech@lists.4d.com> wrote:
> 
> The database is 4D v15.4, iMac 10.14.6, using a Pegasus 9Tb RAID (sweet 
> drive).

**
4D Internet Users Group (4D iNUG)
Archive:  http://lists.4d.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
**

Re: Image Export Issues

[Randy Kaempen via 4D_Tech]

Robert,

> On Mar 31, 2020, at 10:19 PM, Robert McKeever via 4D_Tech 
> <4d_tech@lists.4d.com> wrote:
> 
> The database is 4D v15.4, iMac 10.14.6, using a Pegasus 9Tb RAID (sweet 
> drive).
> 
> I have 151,814 images, in either JPEG or BMP format, and the format is known 
> for each image.
> 
> So, I cycle through the images and figure out what the export be, do a create 
> document for that name, close that file and then do Picture to Blob as 
> follows:
> 
> If (([ScannedDocuments]FileType="JPEG") | ([ScannedDocuments]FileType="JPG"))
> PICTURE TO BLOB([ScannedDocuments]FullImage;$MyBlob;".jpg")
> Else 
> PICTURE TO BLOB([ScannedDocuments]FullImage;$MyBlob;".bmp")
> End if 
> BLOB TO DOCUMENT(document;$MyBlob)
> 
> And I write the document name to a test file with some other info using 
> append document. 
> 
> Periodically, 4D just vanishes. In which case, the text file may or may not 
> contain the entry it died on. This generally happens when the BLOB TO 
> DOCUMENT results in the finder showing a file of zero bytes. In fact, I may 
> get several such files in a block before 4D disappears. No error messages, no 
> system “Hey, it crashed’ logs, just poof.

Have you run the MSC on the data, just to make sure there are no underlying 
data problems?

Have you tried putting in an ON ERR CALL command to see if you can trap an 
error before it causes a crash?

Could some of the images have gotten an incorrect file type, causing the wrong 
processing to be done on it?


Randy Kaempen
Intellex Corporation

**
4D Internet Users Group (4D iNUG)
Archive:  http://lists.4d.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
**

Image Export Issues

[Robert McKeever via 4D_Tech]

The database is 4D v15.4, iMac 10.14.6, using a Pegasus 9Tb RAID (sweet drive).

I have 151,814 images, in either JPEG or BMP format, and the format is known 
for each image.

So, I cycle through the images and figure out what the export be, do a create 
document for that name, close that file and then do Picture to Blob as follows:

If (([ScannedDocuments]FileType="JPEG") | ([ScannedDocuments]FileType="JPG"))
PICTURE TO BLOB([ScannedDocuments]FullImage;$MyBlob;".jpg")
Else 
PICTURE TO BLOB([ScannedDocuments]FullImage;$MyBlob;".bmp")
End if 
BLOB TO DOCUMENT(document;$MyBlob)

And I write the document name to a test file with some other info using append 
document. 

Periodically, 4D just vanishes. In which case, the text file may or may not 
contain the entry it died on. This generally happens when the BLOB TO DOCUMENT 
results in the finder showing a file of zero bytes. In fact, I may get several 
such files in a block before 4D disappears. No error messages, no system “Hey, 
it crashed’ logs, just poof.

So, I went through and added a field called RecNo, and populated it with the 
record number. And, I can restart the export at the point where I have a zero 
byte file exported, and it works properly.

Most of the scans are normal full page scans of letters or forms, and are 1.9Mb 
in size.  Then there are retinal scans at 40.3Mb. 

I’m using a local variable for the blob, and I set its size to zero before the 
picture is loaded into it, and after it is done being sent to disk.

I went to using Append Document(DocFileName) because when 4D disappears, I need 
to know where it stops so I can restart it.

To me, it needs a delay somewhere to prevent the system from stepping on 
itself, but where? I can post the full code for the one table export, if 
desired. I could really use some ideas.

The actual export has been put on hold due to COVID-19. The company needing the 
data had a drop-dead date by which they needed the data, and I said, no 
problem, I’ll pul a backup of the system, bring it to my office, do the export 
and drive it up to their office. Since they need it on an ExFat formatted 
drive, the test version ended up at 2.5Tb, and my estimate of the final was 
3.5Tb to 4Tb. They said, no, their strict isolation rules have them saying it 
needs to be sent electronically. Doing some tests, I calculated 37 days to SFTP 
them the data. So, that isn’t going to happen.

_
Bob McKeever  http://www.mswl.com 
McKeever's Software Wizardry
Port Coquitlam, B.C.
bobmckee...@mac.com




**
4D Internet Users Group (4D iNUG)
Archive:  http://lists.4d.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4d_tech-unsubscr...@lists.4d.com
**