[
https://issues.apache.org/jira/browse/IGNITE-14472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17314747#comment-17314747
]
Ivan Daschinskiy commented on IGNITE-14472:
-------------------------------------------
*Before*:
{code}
------------------------------------------------------------------------------------------
benchmark 'string_get': 10 tests
------------------------------------------------------------------------------------------
Name (time in us) Min Max
Mean StdDev Median IQR
Outliers OPS (Kops/s) Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
benchmark_sync_string_get[simple-128] 352.9188 (1.0) 373.0795 (1.0)
361.5633 (1.0) 7.3642 (2.16) 361.9580 (1.0) 10.8843 (2.59)
3;0 2.7658 (1.0) 10 1000
benchmark_sync_string_get[simple-256] 358.5299 (1.02) 383.5096 (1.03)
370.6923 (1.03) 7.7361 (2.27) 370.2248 (1.02) 4.1944 (1.0)
3;3 2.6977 (0.98) 10 1000
benchmark_sync_string_get[simple-1024] 364.8562 (1.03) 388.6522 (1.04)
375.3570 (1.04) 7.2215 (2.12) 375.6628 (1.04) 9.5607 (2.28)
3;0 2.6641 (0.96) 10 1000
benchmark_sync_string_get[simple-2048] 392.4290 (1.11) 402.3911 (1.08)
396.3332 (1.10) 3.4034 (1.0) 395.3264 (1.09) 5.2861 (1.26)
3;0 2.5231 (0.91) 10 1000
benchmark_sync_string_get[simple-4096] 418.6008 (1.19) 452.7802 (1.21)
426.6729 (1.18) 10.5182 (3.09) 422.9948 (1.17) 10.8302 (2.58)
1;1 2.3437 (0.85) 10 1000
benchmark_async_string_get[simple-128] 516.2550 (1.46) 552.0531 (1.48)
530.5335 (1.47) 9.8132 (2.88) 531.2685 (1.47) 9.8281 (2.34)
2;1 1.8849 (0.68) 10 1000
benchmark_async_string_get[simple-256] 524.5846 (1.49) 572.8096 (1.54)
537.5614 (1.49) 13.5860 (3.99) 536.4263 (1.48) 11.1575 (2.66)
1;1 1.8603 (0.67) 10 1000
benchmark_async_string_get[simple-1024] 524.7691 (1.49) 560.3995 (1.50)
544.3051 (1.51) 12.3997 (3.64) 542.4853 (1.50) 21.1719 (5.05)
4;0 1.8372 (0.66) 10 1000
benchmark_async_string_get[simple-2048] 547.0813 (1.55) 586.5175 (1.57)
563.1756 (1.56) 13.3071 (3.91) 558.9927 (1.54) 17.0010 (4.05)
3;0 1.7756 (0.64) 10 1000
benchmark_async_string_get[simple-4096] 564.6848 (1.60) 615.9083 (1.65)
586.0929 (1.62) 17.1826 (5.05) 587.9250 (1.62) 28.2196 (6.73)
3;0 1.7062 (0.62) 10 1000
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------
benchmark 'string_put': 10 tests
------------------------------------------------------------------------------------------
Name (time in us) Min Max
Mean StdDev Median IQR
Outliers OPS (Kops/s) Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
benchmark_sync_string_put[simple-256] 325.9658 (1.0) 351.0994 (1.0)
337.2916 (1.0) 8.5597 (1.32) 337.3050 (1.0) 9.4780 (1.68)
4;0 2.9648 (1.0) 10 1000
benchmark_sync_string_put[simple-128] 334.7044 (1.03) 357.9547 (1.02)
343.1400 (1.02) 7.7337 (1.19) 342.2236 (1.01) 5.6582 (1.0)
4;2 2.9143 (0.98) 10 1000
benchmark_sync_string_put[simple-1024] 339.7010 (1.04) 370.3226 (1.05)
352.4340 (1.04) 11.0125 (1.69) 350.4053 (1.04) 20.6439 (3.65)
5;0 2.8374 (0.96) 10 1000
benchmark_sync_string_put[simple-2048] 361.9507 (1.11) 384.4600 (1.10)
372.5959 (1.10) 6.5051 (1.0) 371.9587 (1.10) 8.3985 (1.48)
3;0 2.6839 (0.91) 10 1000
benchmark_sync_string_put[simple-4096] 388.3225 (1.19) 421.1529 (1.20)
399.8351 (1.19) 9.5191 (1.46) 399.2213 (1.18) 7.5771 (1.34)
3;1 2.5010 (0.84) 10 1000
benchmark_async_string_put[simple-1024] 445.8800 (1.37) 491.9322 (1.40)
460.7137 (1.37) 15.9652 (2.45) 454.6812 (1.35) 10.8154 (1.91)
2;2 2.1705 (0.73) 10 1000
benchmark_async_string_put[simple-128] 446.2465 (1.37) 471.9876 (1.34)
456.5849 (1.35) 7.7208 (1.19) 456.7414 (1.35) 8.6091 (1.52)
3;0 2.1902 (0.74) 10 1000
benchmark_async_string_put[simple-256] 447.4036 (1.37) 482.0306 (1.37)
462.9988 (1.37) 10.9362 (1.68) 462.0197 (1.37) 16.7424 (2.96)
3;0 2.1598 (0.73) 10 1000
benchmark_async_string_put[simple-2048] 476.9931 (1.46) 505.4164 (1.44)
490.3766 (1.45) 8.2815 (1.27) 490.2793 (1.45) 9.5063 (1.68)
4;0 2.0392 (0.69) 10 1000
benchmark_async_string_put[simple-4096] 494.2129 (1.52) 554.9599 (1.58)
512.5961 (1.52) 17.8196 (2.74) 510.6628 (1.51) 19.7561 (3.49)
2;1 1.9509 (0.66) 10 1000
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
{code}
*after:*
{code}
------------------------------------------------------------------------------------------
benchmark 'string_get': 10 tests
------------------------------------------------------------------------------------------
Name (time in us) Min Max
Mean StdDev Median IQR
Outliers OPS (Kops/s) Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
benchmark_sync_string_get[simple-256] 316.4054 (1.0) 341.0502 (1.0)
326.2234 (1.0) 7.7490 (2.29) 324.1604 (1.0) 11.0799 (3.36)
3;0 3.0654 (1.0) 10 1000
benchmark_sync_string_get[simple-128] 318.1888 (1.01) 347.7654 (1.02)
330.8076 (1.01) 8.4814 (2.51) 331.4587 (1.02) 9.0386 (2.74)
3;1 3.0229 (0.99) 10 1000
benchmark_sync_string_get[simple-1024] 331.4739 (1.05) 349.9133 (1.03)
340.2143 (1.04) 6.0543 (1.79) 339.3230 (1.05) 8.9245 (2.71)
3;0 2.9393 (0.96) 10 1000
benchmark_sync_string_get[simple-2048] 351.5714 (1.11) 384.7058 (1.13)
363.3453 (1.11) 10.4091 (3.08) 359.5281 (1.11) 12.1879 (3.70)
4;0 2.7522 (0.90) 10 1000
benchmark_sync_string_get[simple-4096] 370.1905 (1.17) 397.8165 (1.17)
382.9620 (1.17) 8.4701 (2.51) 383.0705 (1.18) 9.7750 (2.97)
3;0 2.6112 (0.85) 10 1000
benchmark_async_string_get[simple-128] 467.8727 (1.48) 491.7545 (1.44)
481.9482 (1.48) 7.0960 (2.10) 482.9503 (1.49) 6.0939 (1.85)
3;1 2.0749 (0.68) 10 1000
benchmark_async_string_get[simple-256] 479.2206 (1.51) 491.8085 (1.44)
483.7207 (1.48) 3.3771 (1.0) 483.4670 (1.49) 3.2928 (1.0)
2;1 2.0673 (0.67) 10 1000
benchmark_async_string_get[simple-1024] 482.7001 (1.53) 514.7154 (1.51)
490.8721 (1.50) 9.6229 (2.85) 487.8324 (1.50) 11.0874 (3.37)
1;1 2.0372 (0.66) 10 1000
benchmark_async_string_get[simple-2048] 509.9550 (1.61) 545.3259 (1.60)
522.1955 (1.60) 11.4680 (3.40) 517.5992 (1.60) 12.4925 (3.79)
3;1 1.9150 (0.62) 10 1000
benchmark_async_string_get[simple-4096] 530.7630 (1.68) 553.5008 (1.62)
540.2515 (1.66) 7.1359 (2.11) 540.5282 (1.67) 10.6958 (3.25)
3;0 1.8510 (0.60) 10 1000
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------
benchmark 'string_put': 10 tests
------------------------------------------------------------------------------------------
Name (time in us) Min Max
Mean StdDev Median IQR
Outliers OPS (Kops/s) Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
benchmark_sync_string_put[simple-256] 303.6759 (1.0) 331.4159 (1.03)
318.5144 (1.02) 7.8133 (1.25) 317.2772 (1.02) 8.8568 (1.67)
3;0 3.1396 (0.98) 10 1000
benchmark_sync_string_put[simple-128] 303.9300 (1.00) 323.1353 (1.0)
312.9181 (1.0) 6.2555 (1.0) 311.0608 (1.0) 10.5990 (1.99)
4;0 3.1957 (1.0) 10 1000
benchmark_sync_string_put[simple-1024] 311.6221 (1.03) 362.3117 (1.12)
323.5621 (1.03) 14.8098 (2.37) 318.7325 (1.02) 13.1163 (2.47)
1;1 3.0906 (0.97) 10 1000
benchmark_sync_string_put[simple-2048] 328.2298 (1.08) 357.8254 (1.11)
342.6973 (1.10) 7.9928 (1.28) 341.7597 (1.10) 8.6071 (1.62)
2;0 2.9180 (0.91) 10 1000
benchmark_sync_string_put[simple-4096] 363.1949 (1.20) 384.8411 (1.19)
375.5129 (1.20) 6.3627 (1.02) 374.2010 (1.20) 7.5105 (1.41)
3;0 2.6630 (0.83) 10 1000
benchmark_async_string_put[simple-128] 410.8174 (1.35) 437.7358 (1.35)
423.2407 (1.35) 9.1438 (1.46) 422.1930 (1.36) 15.5927 (2.93)
3;0 2.3627 (0.74) 10 1000
benchmark_async_string_put[simple-1024] 429.1320 (1.41) 452.7492 (1.40)
440.7619 (1.41) 6.5106 (1.04) 439.0701 (1.41) 5.3150 (1.0)
3;2 2.2688 (0.71) 10 1000
benchmark_async_string_put[simple-256] 432.6525 (1.42) 456.8929 (1.41)
439.0999 (1.40) 7.2307 (1.16) 436.1768 (1.40) 5.4107 (1.02)
1;1 2.2774 (0.71) 10 1000
benchmark_async_string_put[simple-2048] 458.7029 (1.51) 495.9174 (1.53)
476.6050 (1.52) 11.0565 (1.77) 476.8819 (1.53) 13.2542 (2.49)
3;0 2.0982 (0.66) 10 1000
benchmark_async_string_put[simple-4096] 491.5395 (1.62) 530.0054 (1.64)
503.7158 (1.61) 10.7437 (1.72) 504.0808 (1.62) 11.0932 (2.09)
2;1 1.9852 (0.62) 10 1000
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
{code}
> Performance drop on primitive operations.
> -----------------------------------------
>
> Key: IGNITE-14472
> URL: https://issues.apache.org/jira/browse/IGNITE-14472
> Project: Ignite
> Issue Type: Bug
> Components: python, thin client
> Affects Versions: python-0.4.0
> Reporter: Ivan Daschinskiy
> Assignee: Ivan Daschinskiy
> Priority: Blocker
> Labels: python, thin
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Reason of performance drop: header struct of Response is not cached (now it
> is instance variable, earlier it will be class variable)
> Performance drop approx 15 %.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
