Hi Walaa Very happy to see this, our team basically do the same thing, a unified SQL layer: 1. Spark: RelNode -> Spark DataFrame plan 2. Presto: RelNode -> In string SQL 3. Clickhouse: RelNode -> Serialized RelNode 4. Flink -> TBD(with datastream API or table API)
I do point 1 both in my previous company and current company, maybe I can participate in this part: analyze and translate Spark Catalyst plans. Regards! Aron Tao Walaa Eldin Moustafa <[email protected]> 于2020年12月12日周六 上午5:34写道： > Hi Calcite community, > > I wanted to share a recently published LinkedIn's blog series article [1] > on how Calcite helps us build a smarter data lake using Coral [2]. Hope you > find it interesting. Also, if you want to discuss with our team and the > data lake + Calcite community, please feel free to join our Coral Slack > workspace [3]. > > [1] https://engineering.linkedin.com/blog/2020/coral > [2] https://github.com/linkedin/coral > [3] > > https://join.slack.com/t/coral-sql/shared_invite/zt-j9jw5idg-mkt3fjA~wgoUEMXXZqMr6g > > Thanks, > Walaa. >
