https://docs.marklogic.com/guide/ingestion/formats#id_89015 is a little more 
explicit.

There's no upper limit on binary storage - well, maybe something absurd like 
2^64 Bytes. I've done projects using DVD images: 4-GB or so. With large binary 
support you can even store them outside the regular forest data directory, 
which can be convenient. For GB-sized BLOBs, retrieval may be limited by I/O 
paths: sequential disk reads, and network writes. A little OS tuning can help 
get the most from both of those.

Text documents are limited to 64-MiB. If you want to store larger CLOB 
documents you could always force them to binary format. That's fine for storage 
and retrieval, but the contents won't be indexed.

For XML "The maximum size of a single XML fragment is 128 MB for 32-bit 
machines, 512 MB for 64-bit machines."

However from a design standpoint you should avoid going anywhere near there as 
a common use-case. Documents act like rows, not tables. Make the document the 
unit of work for queries and updates, and your typical document sizes will 
likely fall somewhere in the range of 100-B to 10-MiB. It's fine to have the 
occasional outlier, as long as the document is the unit of work for queries and 
updates.

In some very specialized cases you can also create sub-fragments within an XML 
document. But that's rare. Before going down that road, discuss it with 
MarkLogic support or an experienced MarkLogic developer, or both.

-- Mike

On 18 Sep 2014, at 11:45 , Gary Russo <[email protected]> wrote:

> The MongoDB size limitation of a json document is 16MB.
>  
> Does MarkLogic have a similar limitation for XML and Binary docs?
>  
> How does MarkLogic ingest a large binary file such as a video or Excel 
> spreadsheet that is greater than 2MB?
>  
> The online docs state that document size and quantity is constrained by 
> available memory, disk space and system file size limit. => 
> http://docs.marklogic.com/guide/ingestion/formats#id_24381
>  
> This is nice but I’d like to know of some real world experiences.
>  
>  
> What is the largest file that anyone has ingested?
>  
> Has anyone ingested files greater than 20 MB, 100 MB, 1 GB ?
>  
>  
>  
> Gary Russo
> Enterprise NoSQL Developer
> http://garyrusso.wordpress.com
>  
> _______________________________________________
> General mailing list
> [email protected]
> http://developer.marklogic.com/mailman/listinfo/general

_______________________________________________
General mailing list
[email protected]
http://developer.marklogic.com/mailman/listinfo/general

Reply via email to