nuno-faria commented on issue #20052: URL: https://github.com/apache/datafusion/issues/20052#issuecomment-3833824691
@alamb I did some tests on `main` and on `branch-52` with the GitHub runners and I confirmed that the `branch-52` version is 2x fast. Most of the time comes from executing the sqllogictests: ``` branch-52 Run sqllogictest 1h 11m 34s main Run sqllogictest 2h 37m 1s ``` The difference comes from the SQLite tests. Here is the top 20 tests that became slower (e.g., the `index/between/10/slt_good_0.slt` test became more than 5 minutes slower): ``` +-----------------------------------------------------------------------+---------------+---------------+--------------------+ | file | before | after | diff | +-----------------------------------------------------------------------+---------------+---------------+--------------------+ | ../../datafusion-testing/data/sqlite/index/between/10/slt_good_0.slt | 45.284665734 | 363.632612321 | 318.347946587 | | ../../datafusion-testing/data/sqlite/index/in/100/slt_good_4.slt | 51.998236459 | 369.020513989 | 317.02227753 | | ../../datafusion-testing/data/sqlite/index/in/10/slt_good_1.slt | 43.577265192 | 352.48690408 | 308.909638888 | | ../../datafusion-testing/data/sqlite/index/between/100/slt_good_2.slt | 56.348399856 | 362.648541997 | 306.300142141 | | ../../datafusion-testing/data/sqlite/index/between/1/slt_good_0.slt | 45.882394614 | 351.049388436 | 305.166993822 | | ../../datafusion-testing/data/sqlite/index/between/10/slt_good_3.slt | 43.392583957 | 344.005136131 | 300.612552174 | | ../../datafusion-testing/data/sqlite/index/in/10/slt_good_5.slt | 41.691856938 | 339.81796977 | 298.126112832 | | ../../datafusion-testing/data/sqlite/index/in/10/slt_good_0.slt | 42.337456143 | 339.853184045 | 297.515727902 | | ../../datafusion-testing/data/sqlite/index/between/100/slt_good_4.slt | 54.671002818 | 351.113308144 | 296.442305326 | | ../../datafusion-testing/data/sqlite/index/between/100/slt_good_0.slt | 49.172567428 | 341.144175011 | 291.97160758300004 | | ../../datafusion-testing/data/sqlite/index/in/100/slt_good_2.slt | 53.117645256 | 340.699660917 | 287.582015661 | | ../../datafusion-testing/data/sqlite/index/between/100/slt_good_1.slt | 52.121360006 | 338.765991651 | 286.644631645 | | ../../datafusion-testing/data/sqlite/index/in/10/slt_good_2.slt | 44.259036248 | 330.043900715 | 285.78486446700003 | | ../../datafusion-testing/data/sqlite/index/in/10/slt_good_3.slt | 38.736811166 | 322.379091433 | 283.642280267 | | ../../datafusion-testing/data/sqlite/index/between/10/slt_good_2.slt | 42.036611555 | 318.429497273 | 276.392885718 | | ../../datafusion-testing/data/sqlite/index/between/10/slt_good_4.slt | 37.413479926 | 311.6285902 | 274.21511027400004 | | ../../datafusion-testing/data/sqlite/index/in/10/slt_good_4.slt | 41.202924903 | 313.075850978 | 271.872926075 | | ../../datafusion-testing/data/sqlite/index/in/1000/slt_good_0.slt | 144.132563523 | 414.36981312 | 270.237249597 | | ../../datafusion-testing/data/sqlite/index/in/100/slt_good_1.slt | 43.40844384 | 305.739891729 | 262.331447889 | | ../../datafusion-testing/data/sqlite/index/between/100/slt_good_3.slt | 47.71860273 | 309.951231124 | 262.232628394 | +-----------------------------------------------------------------------+---------------+---------------+--------------------+ ``` However, I couldn't reproduce the results locally. Both before and after had around the same execution time, so I don't know what could be causing this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
