Hi,

This is regarding my question about the datafusion's vision and roadmap.

As a new contributor, I wonder what would be a vision and roadmap that
most of the contributors can/already have be aligned upon.

Maybe due to my lack of prior context I might have missed such
discussion, or maybe this is intentionally left to be open so that
different contributors and companies can have their own features to be
compatible. But I still believe in the value of having one, and it can
somehow be shown in the README.md or contributing guideline, so that
users and the community can see what to expect from and contribute to.

By "vision" I mean something that's necessarily vague and serving as an
overarching goal, e.g. "leveraging rust and arrow and become the most
performant SQL-compatible query engine on a single node", or "fully
compatible with (most of) PostgreSQL syntax and pluggable in most of the
web-scale analytical engines".

I believe having this in place can help pushing the project forwards
esp. in cases of trade off, e.g. sticking to newest rust release v.s.
providing LTS, or incorporating as many features as possible (e.g.
recursive CTE? BSON support? query materializations?) v.s. keeping
binary size small and everything else into a plugin mode.

Reply via email to