ManvithPanyam commented on PR #39851: URL: https://github.com/apache/beam/pull/39851#issuecomment-5381740288
@tvalentyn — opened a fix for this. Root cause: Beam's `.xs()` assumed static output shape across partitions, but pandas collapses dimensionality on single-row matches, breaking cross-partition concat. One thing flagged for review: the proxy can't distinguish single-match vs. duplicate-match keys at graph-construction time (no row data available yet), so it always predicts the dimensionality-reduced type. Documented this as a known limitation in the code — same class of tradeoff as other data-dependent-shape ops in this module. Open to feedback if there's a cleaner way to handle it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
