Yicong-Huang opened a new issue, #5556:
URL: https://github.com/apache/texera/issues/5556

   ### Task Summary
   
   Add a real end-to-end micro-benchmark of the Arrow Flight data path that 
spawns a live `PythonWorkflowWorker` actor (real Pekko actor + real Python 
subprocess via `texera_run_python_worker.py` + real Arrow Flight gRPC 
transport) wired to an identity Python UDF, sweeps a 36-config grid (batch_size 
× schema_width × string_len), and reports per-batch send→echo latency 
percentiles plus throughput. Wire results into the github-action-benchmark 
dashboard via a bench-agnostic `Benchmarks` workflow + `bin/run-benchmarks.sh` 
entry point so future bench suites (e.g. JMH for `ArrowUtils.fromTexeraSchema` 
/ `appendTexeraTuple`) can plug in without touching CI.
   
   ### Task Type
   
   - [x] DevOps / Deployment / CI
   - [x] Performance


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to