alamb opened a new issue, #15914:
URL: https://github.com/apache/datafusion/issues/15914

   ### Is your feature request related to a problem or challenge?
   
   Many DataFusion users are using DataFusion to execution workloads originally 
developed for Apache Spark. Examples include
   - [DataFusion Comet](https://datafusion.apache.org/comet/) (@andygrove 
@comphead , etc) 
   - [LakeHQ / Sail](https://github.com/lakehq/sail) (@shehabgamin )
   - Various internal pileines / engines  (e.g. that @Omega359 and I think 
@Blizzara use)
   
   They often do this for superior performance
   
   * Part of running Spark workloads is emulating Spark sematics
   * Emulating Spark semantics requires (among other things) functions 
compatible with Spark  (which differs in semantics to the functions included in 
DataFusion)
   
   Several projects are in the process of implementing Spark compatible 
function libraries using DataFusion's extension APIs. However. we concluded in 
https://github.com/apache/datafusion/issues/5600 that we could join forces and 
maintain a spark compatible funciton library in the core datafusion repo. 
@shehabgamin  has implemented the first step in 
https://github.com/apache/datafusion/pull/15168 🙏 
   
   ### Describe the solution you'd like
   
   This ticket tracks "completing" the spark function library started in 
https://github.com/apache/datafusion/pull/15168
   
   ### Describe alternatives you've considered
   
   Related Issues
   - [ ] https://github.com/apache/datafusion/issues/5600
   - [ ] https://github.com/apache/datafusion/pull/15168
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org

Reply via email to