W dniu 2011-06-14 16:13, Maxim Valyanskiy pisze:
Tika detects datatype and extracts text in one pass through supplied input stream. OOXML parser requires random access to ZIP archive files, so there is only two alternativies - to buffer data in memory or store it on disk. Overhead appears only when you need just to detect data type without text extraction.
The way I see it, overhead appears if I pass a normal ZIP file, which I can process in a streaming way (limitations notwithstanding). Then when I pass the file to the container detector, it has to be buffered regardless of whether the buffering is necessary.
So overhead appears when I detect the data type without text extraction AND when I detect data type on plain, non-ooxml zips which could be streamed.
Am I right? Antoni Myłka [email protected]
