cj-zhukov commented on PR #18946: URL: https://github.com/apache/datafusion/pull/18946#issuecomment-3588064235
I ran into issues when reading data from CSV files located outside the `datafusion-examples` crate. The relative paths behaved differently in CI than locally, so the examples couldn’t reliably access files stored under the main `datafusion` crate. As a workaround, I embedded the CSV content directly in the example as bytes, wrote it to a temporary file, and registered that file with the context. This keeps the example self-contained and ensures it works consistently in both local development and CI. If we want a cleaner long-term approach, we may want to consider storing example-specific data files inside the `datafusion-examples` crate itself (e.g., an `examples/data/ `directory). That would allow examples to load files without depending on paths outside the crate. I’m open to discussing better structures for handling example data across the project. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
