robertwb commented on a change in pull request #16101:
URL: https://github.com/apache/beam/pull/16101#discussion_r765265868
##########
File path: sdks/python/apache_beam/dataframe/transforms_test.py
##########
@@ -348,6 +350,44 @@ def test_rename(self):
}, errors='raise'))
+class FusionTest(unittest.TestCase):
+ @staticmethod
+ def fused_stages(p):
+ return p.result.metrics().query(
+ metrics.MetricsFilter().with_name(
+ fn_runner.FnApiRunner.NUM_FUSED_STAGES_COUNTER)
+ )['counters'][0].result
Review comment:
I'm open to ideas here. At the end of the day, I'm wanting to assert
that things get sufficient fused (possibly catching issues with side inputs as
well as shuffles).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
