shashbha14 commented on code in PR #49271:
URL: https://github.com/apache/arrow/pull/49271#discussion_r2803322222
##########
docs/source/python/ipc.rst:
##########
@@ -220,14 +221,50 @@ In such case the operating system will be able to page in
the mapped memory
lazily and page it out without any write back cost when under pressure,
allowing to more easily read arrays bigger than the total memory.
+.. ipython:: python
+
+ with pa.memory_map('bigfile.arrow', 'rb') as source:
+ loaded_array = pa.ipc.open_file(source).read_all()
+ print("LEN:", len(loaded_array))
+ print("RSS: {}MB".format(pa.total_allocated_bytes() >> 20))
+
+Security considerations for untrusted IPC data
Review Comment:
Thanks for catching that! I've removed the unrelated docs commit. The PR now
only contains the pandas Categorical deprecation warnings fix.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
