mr-brobot commented on issue #8011: URL: https://github.com/apache/iceberg/issues/8011#issuecomment-1627473683
@jacopotagliabue Great to hear I'm not alone in this! 😄 I have this working on my fork and successfully tested in AWS Lambda. There were two errors in Lambda, one from using `multiprocessing.pool.ThreadPool` and another from using `multiprocessing.Value` for synchronization in the `pyarrow` adapter, both related to the lack of a `/dev/shm` mount. Using `concurrent.futures.ThreadPoolExecutor` solves that scenario. Just finishing up some cleanup now. I plan to have a PR open tonight or early tomorrow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
