Github user ggevay commented on a diff in the pull request: https://github.com/apache/flink/pull/3511#discussion_r142032957 --- Diff: flink-test-utils-parent/flink-test-utils/src/main/java/org/apache/flink/test/util/MultipleProgramsTestBase.java --- @@ -146,6 +151,7 @@ public static void teardown() throws Exception { public static Collection<Object[]> executionModes() { return Arrays.asList( new Object[] { TestExecutionMode.CLUSTER }, + new Object[] { TestExecutionMode.CLUSTER_WITH_CODEGENERATION_ENABLED }, --- End diff -- The difference in testing time between not having `TestExecutionMode.CLUSTER_WITH_CODEGENERATION_ENABLED` and having it is about 1 minute on my laptop. About half of this are the tests based on`DriverBaseITCase` and `CopyableValueDriverBaseITCase`. (Here is a patch for removing `TestExecutionMode.CLUSTER_SORTER_CODEGEN`: https://github.com/ggevay/flink/commit/be1f1c3041fdf6c4dd487b2643f2d399ee24abe9)
---