alamb commented on issue #14608: URL: https://github.com/apache/datafusion/issues/14608#issuecomment-2797923658
> I just read your blogpost today, and I am really happy to have a faster generator. The post focussed on generating tpc-h to files, but I see you also discussed something like this: > > ``` > select * from tpch.lineitem(1); > ``` > > Is generating tpch-data and immediately running queries on it without going to the filesystem still on the table? I want to benchmark data fusion on different unikernels, and avoiding the file system entirely would simplify things a lot. Sure! I think making a table function would be a great idea personally. That then lets you make files like ```sql copy (select * from tpch.lineitem(0)) to 'lineitem.paruet'; ``` 🌶 ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
