carloea2 opened a new pull request, #8786: URL: https://github.com/apache/texera/pull/8786
### What changes were proposed in this PR? Add OLS Analysis with explicit response, predictors, intercept and missing-value handling. Return coefficient inference and model statistics from one full-table fit. Pin statsmodels 0.15.0 and update bundled licenses. This buffers the full input in one Python worker. Rank-deficient fits are rejected. Standalone Python export is not included. ### Any related issues, documentation, discussions? Closes #8785 ### How was this PR tested? Local candidate checks: 44 focused Scala tests with real Python math and lifecycle checks passed; all 118 Python descriptors passed generated-code checks. Scala formatting, scalafix, resource Ruff checks and dependency license audits passed. ```text sbt "WorkflowOperator/testOnly org.apache.texera.amber.operator.statistics.OLSAnalysisOpDescSpec org.apache.texera.amber.operator.sklearn.SklearnLinearRegressionOpDescSpec org.apache.texera.amber.operator.sklearn.training.SklearnTrainingLinearRegressionOpDescSpec org.apache.texera.amber.util.PythonCodeRawInvalidTextSpec org.apache.texera.amber.operator.metadata.OperatorMetadataGeneratorSpec org.apache.texera.amber.operator.LogicalOpSpec" sbt "WorkflowOperator/scalafix --check" "WorkflowOperator/Test/scalafix --check" scalafmtCheckAll ``` Chrome at 1707 by 979 on localhost: run OLS with and without intercept, save and reimport. For 125 synthetic rows, 121 used and four omitted, results matched base R within 1e-9. Checked missing-value errors, invalid columns and rank deficiency. Set UDF_PYTHON_PATH to Python 3.12 with the declared requirements. These local checks preceded today's rebase onto upstream main 98d3d4b1ec. Candidate changes are unchanged. Remote CI and the full operating-system matrix are not claimed. Input and output from the candidate. | Input | OLS output | | --- | --- | |  |  | ### Was this PR authored or co-authored using generative AI tooling? Generated-by: OpenAI Codex (exact authoring version not recorded). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
