scholarsmate commented on issue #714: URL: https://github.com/apache/daffodil-vscode/issues/714#issuecomment-1645713022
I am testing and developing a solution in Ωedit for dealing with large scale transforms in general. These will be memory efficient single transaction transforms. These transforms will enable us to do large scale replace as described above. In addition, we can support any number of other transforms like up, down, and switch casing, compression/decompression, encoding/decoding, etc. You can think of this like running a stream through `sed` or `awk` and collecting the results, and this transformation operation is done in a single edit transaction. I'll also consider non-transformational "scanning" functions like search, profiling, hashing, etc where the data is only read and some result object is populated. You can think of this like running a stream through `grep`, `wc`, or `md5sum` and collecting the results. No edit transactions are made, but up to the entire stream is materialized all at once, then read. There are benefits to having access to the entire stream for doing searches since you don't need to worry about managing overlapping segments for a sliding window technique (what search is currently doing). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
