Gerrrr commented on PR #154: URL: https://github.com/apache/otava/pull/154#issuecomment-4598315617
I have briefly tried `--deterministic-edivisive` using https://github.com/apache/otava-playground and got interesting results. First of all, I could not make `orig-edivisive` and `deterministic-edivisive` detect different changepoints on TigerBeetle dataset, regardless of specified p-value. Second, I have tried also tried analyzing internal Kafka Streams benchmark results. Here are 3 different datasets, let's call them A, B, C. **Data** * `A: [22785.0, 21586.0, 21740.0, 23909.0, 24511.0, 24539.0, 24323.0, 23508.0, 24727.0, 24461.0, 24575.0, 23846.0, 24272.0, 25103.0, 24287.0, 24538.0, 23710.0, 24720.0, 24964.0, 24721.0, 24580.0, 23691.0, 23914.0, 23428.0, 23961.0, 24135.0, 24792.0, 23437.0, 23512.0, 24255.0, 24702.0, 23948.0, 23927.0, 23475.0, 23936.0, 23926.0, 23858.0, 2116.0, 21742.0, 22949.0, 22413.0, 22485.0, 23560.0, 23235.0, 23970.0, 22827.0, 22592.0, 22823.0, 23049.0, 23094.0, 23319.0, 22842.0, 23341.0, 22684.0, 23006.0, 23192.0, 23048.0, 22837.0, 23100.0, 23140.0, 23200.0, 23299.0, 23179.0, 23190.0, 23086.0, 23265.0, 23697.0, 23568.0, 22902.0, 22777.0, 23286.0, 23025.0, 16896.0, 16497.0, 23165.0, 22831.0, 22465.0, 23107.0, 23304.0, 22618.0, 22784.0, 22408.0, 21834.0, 22913.0, 23182.0, 22628.0, 23070.0, 23430.0, 23520.0, 22894.0, 23959.0, 27440.0, 27198.0, 27518.0, 26924.0, 27271.0, 26651.0, 27587.0, 27019.0, 27157.0, 26892.0, 26839.0, 26423.0, 27125.0, 26929.0, 27078.0, 26801.0, 27264.0, 27006.0, 26872.0, 26331.0, 26429.0, 26755.0, 26606.0, 26585.0, 26494.0, 27146.0, 26556.0, 24517.0, 25560.0, 25978.0, 25765.0, 25889.0, 25566.0, 25876.0, 26619.0, 25616.0, 26605.0, 26639.0, 26484.0, 25971.0, 26350.0, 25382.0, 26273.0, 26571.0, 25852.0, 25676.0, 25677.0, 22368.0, 21453.0, 22756.0, 21922.0, 22460.0, 32861.0, 32761.0, 32306.0, 33505.0, 33714.0, 32953.0, 34102.0, 33095.0, 33264.0, 32294.0, 32169.0, 32683.0, 33629.0, 32892.0, 33391.0, 32980.0, 32430.0, 25686.0, 33551.0, 33870.0, 34050.0, 33733.0, 31889.0, 32559.0, 23916.0, 24104.0, 27927.0, 29843.0, 28024.0, 32577.0, 29878.0, 23974.0, 24381.0, 24868.0, 24570.0, 23728.0, 24151.0, 24927.0, 25025.0, 24672.0, 25819.0, 25204.0, 24793.0, 25015.0, 25235.0, 25117.0, 28782.0, 29322.0, 29590.0, 29510.0, 29868.0, 30602.0, 30441.0, 29253.0, 30748.0, 28778.0, 27916.0, 28690.0, 28051.0, 27283.0, 30100.0]` * `B: [73082.0, 74039.0, 71791.0, 72181.0, 72640.0, 74487.0, 74814.0, 73184.0, 72858.0, 74467.0, 62087.0, 60242.0, 60122.0, 56709.0, 59204.0, 62751.0, 61544.0, 52306.0, 55789.0, 50221.0, 54549.0, 61100.0, 65098.0, 63058.0, 57003.0, 62535.0, 60224.0, 58660.0, 62574.0, 62620.0, 57103.0, 58920.0, 63341.0, 64013.0, 61220.0, 62938.0, 60705.0, 61562.0, 64215.0, 61321.0, 62176.0, 55683.0, 57350.0, 61833.0, 60924.0, 62823.0, 62083.0, 62742.0, 65115.0, 60199.0, 60130.0, 62030.0, 61953.0, 63170.0, 62697.0, 860.0, 51506.0, 61696.0, 54232.0, 58574.0, 56817.0, 58403.0, 61657.0, 62498.0, 59364.0, 59444.0, 60807.0, 59767.0, 59030.0, 59835.0, 59701.0, 60148.0, 61648.0, 60184.0, 61798.0, 61626.0, 59270.0, 63485.0, 60068.0, 63620.0, 57437.0, 61773.0, 60206.0, 58678.0, 60817.0, 60500.0, 60532.0, 54948.0, 58927.0, 59125.0, 59127.0, 57627.0, 59311.0, 59447.0, 57279.0, 59243.0, 60035.0, 59262.0, 56920.0, 60228.0, 60811.0, 55831.0, 59214.0, 59319.0, 59625.0, 60607.0, 57844.0, 56816.0, 62007.0, 65625.0, 72666.0, 74003.0, 75510.0, 73884.0, 76251.0, 72078.0, 77097.0, 74305.0, 75631.0, 72254.0, 74196.0, 72132.0, 77416.0, 72464.0, 73874.0, 75227.0, 71641.0, 76270.0, 72420.0, 73452.0, 75291.0, 75266.0, 76690.0, 71394.0, 74666.0, 76970.0, 68724.0, 72249.0, 77083.0, 72544.0, 74172.0, 74742.0, 69504.0, 73728.0, 68426.0, 69852.0, 72687.0, 71859.0, 69195.0, 69418.0, 71915.0, 70661.0, 68556.0, 77809.0, 72432.0, 73983.0, 72227.0, 74092.0, 60940.0, 55148.0, 59613.0, 58009.0, 57599.0, 70409.0, 72747.0, 73713.0, 62157.0, 72644.0, 67992.0, 72263.0, 62314.0, 72821.0, 64470.0, 70023.0, 67186.0, 70441.0, 72100.0, 62632.0, 65942.0, 65303.0, 73182.0, 64105.0, 71253.0, 72119.0, 66040.0, 66501.0, 61056.0, 59087.0, 59699.0, 53586.0, 56286.0, 56384.0, 56853.0, 52382.0, 48014.0, 47280.0, 48255.0, 59950.0, 49603.0, 48245.0, 49192.0, 49663.0, 52149.0, 55167.0, 53970.0, 58495.0, 55946.0, 50964.0, 54767.0, 58329.0, 54294.0, 56923.0, 58313.0, 57799.0, 51907.0, 56917.0, 52431.0, 64584.0, 58228.0, 58904.0, 61110.0 , 57959.0, 52237.0, 56359.0]` * `C: [19265.0, 19642.0, 19453.0, 18860.0, 20255.0, 20310.0, 19619.0, 19724.0, 19732.0, 19481.0, 18954.0, 19150.0, 19854.0, 19258.0, 19689.0, 17070.0, 17305.0, 16986.0, 15469.0, 17448.0, 18470.0, 18038.0, 18013.0, 17992.0, 18570.0, 17974.0, 18518.0, 18546.0, 18449.0, 18392.0, 17926.0, 18490.0, 18271.0, 18099.0, 18205.0, 18290.0, 18315.0, 18149.0, 18365.0, 18355.0, 17967.0, 17040.0, 18676.0, 19106.0, 18738.0, 18597.0, 18380.0, 19055.0, 19024.0, 18650.0, 18327.0, 18411.0, 18546.0, 17998.0, 863.0, 16622.0, 18278.0, 17005.0, 17653.0, 17883.0, 18036.0, 18933.0, 18478.0, 18867.0, 18641.0, 18493.0, 18690.0, 18021.0, 18141.0, 17986.0, 18708.0, 17902.0, 17808.0, 18645.0, 18639.0, 17816.0, 18140.0, 17904.0, 18318.0, 18428.0, 18338.0, 18695.0, 18662.0, 18094.0, 18594.0, 18647.0, 18608.0, 18774.0, 18397.0, 18357.0, 18730.0, 11747.0, 11663.0, 18922.0, 18455.0, 18251.0, 18056.0, 18695.0, 18321.0, 18375.0, 18670.0, 18529.0, 17976.0, 18675.0, 18784.0, 18353.0, 18506.0, 18581.0, 18710.0, 18505.0, 18640.0, 20621.0, 20140.0, 20465.0, 20561.0, 20393.0, 20538.0, 20311.0, 20537.0, 20374.0, 19645.0, 20229.0, 20136.0, 20588.0, 21221.0, 21008.0, 20719.0, 20535.0, 20514.0, 20747.0, 19760.0, 20484.0, 20590.0, 20865.0, 20449.0, 20259.0, 20509.0, 20245.0, 17731.0, 18356.0, 17913.0, 17790.0, 17702.0, 17852.0, 18330.0, 20679.0, 20987.0, 21215.0, 21428.0, 21043.0, 21288.0, 20376.0, 20063.0, 17770.0, 17950.0, 22848.0, 28335.0, 29317.0, 29026.0, 28476.0, 27810.0, 28188.0, 28123.0, 26962.0, 27235.0, 27764.0, 27393.0, 27652.0, 27652.0, 26402.0, 27083.0, 28003.0, 27422.0, 23520.0, 18498.0, 27584.0, 27827.0, 18239.0, 21971.0, 23214.0, 23885.0, 22269.0, 23604.0, 24543.0, 23585.0, 22393.0, 24240.0, 24372.0, 23005.0, 23387.0, 23846.0, 23353.0, 23555.0, 23252.0, 22976.0, 22691.0, 24577.0, 23859.0, 23429.0, 24844.0, 23768.0, 22775.0, 25584.0, 25357.0, 24731.0, 25407.0, 22779.0, 24749.0, 23523.0, 22863.0, 23038.0, 24235.0, 24468.0, 22855.0, 22737.0]` **Results (reproducible with otava-playground)** A: <img width="2952" height="1237" alt="Screenshot 2026-06-01 at 7 54 33 PM" src="https://github.com/user-attachments/assets/e6ad915d-3812-4aff-9d17-eaad0b041234"; /> B: <img width="2977" height="1293" alt="Screenshot 2026-06-01 at 7 53 47 PM" src="https://github.com/user-attachments/assets/55555cde-a2aa-4c8f-9734-f18cdda8f9d4"; /> C: <img width="2942" height="1227" alt="Screenshot 2026-06-01 at 7 55 27 PM" src="https://github.com/user-attachments/assets/4f5425e6-3bb9-4d1f-9e14-b40e324da204"; /> As you can see, results for `deterministic-edivisive` and `orig-edivisive` are _very_ close. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
