kz930 opened a new pull request, #8481:
URL: https://github.com/apache/texera/pull/8481

   ### What changes were proposed in this PR?
   
   An operator that cuts a numeric column into bins and adds the bin a row fell 
in as a column of its own.
   
   Two cuts, because they answer different questions. Equal width divides the 
span into bins of one size; equal frequency cuts at the quantiles, so the bins 
hold about as many rows as each other. The second is why the operator reads the 
whole table before it emits: a quantile is not known until the last row has 
arrived.
   
   The bin reads as its own range, `(2.5, 5.0]`, which is a label to group by 
rather than a number to do arithmetic on.
   
   ### Any related issues, documentation, discussions?
   
   Part of #8325, 24 of 24; that issue lists the set in order.
   
   Closes #8479, the task this change is the whole of.
   
   The same gap as #8478, on the other kind of column. Grouping by a continuous 
number puts almost every row in a group of its own, so counts per age bracket 
or per price band could not be asked for; a user wanting them had to write a 
Python UDF.
   
   ### How was this PR tested?
   
   Ten unit tests in the operator's own spec, over the schema it declares and 
the Python it emits on both paths. The parity harness runs it on four 
configurations, one per cut plus a hostile column name and an empty cell, 
comparing the engine's answer against the exported script's.
   
   ### Was this PR authored or co-authored using generative AI tooling?
   
   Generated-by: Claude Code (Opus 5)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to