There appears to be seem significant issues with 4D and large : Text, 
Blobs, and Files.

After playing for way too long, I have found the following 
issues/limitations when working with large files:
- Receive Packet :
  -- into Text there appears to be limit of around 169megs after which 
import fails.
  -- into Blob there is a limit which appears to be available memory 
specific, it is larger then text, but still far less then the size 
limit for either text or blob. I was able to get, once, 1.6gb imported, 
but mostly failure of receive packet into blob is around 750-800megs.
in either instance, 4D does, mostly, generate an error -108 (not enough 
memory) but not always. often enough 4D just fails the receive packet, 
OK = 0, blob or text is empty, and no error is generated.

Additionally, Blob to Text has issues. I have not worked out the point 
where the limit is, but when the blob is somewhere between 150megs, and 
500megs the command chokes. 4D throws an error (-1 -- most probably a 
resource issue) and does not convert the blob contents to text.

These limits maybe imposed by the 32 bit architecture of v13, I have 
not tried on on a 64 bit version of 4D.

All of this makes trying to manage very large text files difficult.


On Tue, 26 Sep 2017 09:34:25 +0000, Keisuke Miyako via 4D_Tech wrote:
> you should use BLOB instead of TEXT with RECEIVE PACKET, with a stop 
> char or max size, which you like.
> just remember to clear the BLOB every iteration and save as you go.
> 
> don't use arrays (defeats the purpose of chunking),
> don't use text (bloats the size and adds overhead for decoding).
> 
>> 2017/09/26 6:30、Chip Scheide via 4D_Tech <[email protected]> のメール:
>> Is there a limit to how much can be read in one 'chunk' via Receive Packet?
> 
> 
> 
> 
> **********************************************************************
> 4D Internet Users Group (4D iNUG)
> FAQ:  http://lists.4d.com/faqnug.html
> Archive:  http://lists.4d.com/archives.html
> Options: http://lists.4d.com/mailman/options/4d_tech
> Unsub:  mailto:[email protected]
> **********************************************************************
---------------
Gas is for washing parts
Alcohol is for drinkin'
Nitromethane is for racing 
**********************************************************************
4D Internet Users Group (4D iNUG)
FAQ:  http://lists.4d.com/faqnug.html
Archive:  http://lists.4d.com/archives.html
Options: http://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:[email protected]
**********************************************************************

Reply via email to