GitHub user kunwp1 added a comment to the discussion: Supporting Directory-Based Dataset Access in UDFs
The CU has a local volume, but it starts empty. Our data currently lives in Object Storage rather than on a physical hard drive. We can have two ways to get it to the CU: - The Download Approach: We grab the files from the cloud and save a copy onto the CU’s local volume. It's simple and reliable, which is why I'm leaning toward it. - The Mounting Approach: This is likely what you are thinking of: making the cloud storage appear as a local folder. I haven't explored much on this but it seems much harder to set up. GitHub link: https://github.com/apache/texera/discussions/4352#discussioncomment-16484226 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
