alamb opened a new issue, #26257:
URL: https://github.com/apache/datafusion/issues/26257

   TLDR; I worry that the ease of adding features with AI tools is leading 
DataFusion to become overly complicated and that the additional complexity will 
eventually slow down / ruin the project
   
   I think @2010YOUY01's way of phrasing my concern  in this comment: 
https://github.com/apache/datafusion/issues/24768#issuecomment-6126086240
   
   > My imaginary failure mode is, after exceeding some complexity threshold, 
AI always fix one bug by bringing in two new bugs
   
   AI tools are amazing in terms of how much code you can write and how much it 
lowers the barriers to contribution. However, I worry about the 
   
   Recent Examples:
   * https://github.com/apache/datafusion/pull/26035 from @viirya where there 
was quite a bit of test and code to handle LIMIT + OFFSET that overflows an i64 
(which I think would never happen in practice); 
   * https://github.com/apache/datafusion/pull/26241 which looks very 
plausible, but I think the veneer of plausibility masks the fact it isn't 
really a bug.
   
   I am not sure if anyone really has the experience yet to know if this 
is/will happen but I worry about it
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to