[jira] [Commented] (IGNITE-7999) Enhance performance of the thin JDBC streaming mode

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472190#comment-16472190
 ] 

ASF GitHub Bot commented on IGNITE-7999:


GitHub user tledkov-gridgain opened a pull request:

https://github.com/apache/ignite/pull/3983

IGNITE-7999: for 2.4



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/gridgain/apache-ignite ignite-7999-2.4-next

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/ignite/pull/3983.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3983


commit 915dd2966084d78f7b4f3d482e6bd25f860c1e23
Author: Alexey Goncharuk 
Date:   2018-01-31T08:22:26Z

IGNITE-7569 Fixed index rebuild future - Fixes #3454.

commit 8ea8609259039852ab0c26f26ac528c1ffae7c94
Author: Alexey Goncharuk 
Date:   2018-01-31T08:24:57Z

IGNITE-7577 Fixing public API active flag on baseline changes - Fixes #3455.

commit c8ce1f66e98b3174d771a3b801a2538499dc2c3d
Author: Ivan Rakov 
Date:   2018-01-31T09:51:09Z

IGNITE-7475 Improved VerifyBackupPartitionsTask to calculate partition 
hashes in parallel - Fixes #3407.

Signed-off-by: Alexey Goncharuk 

commit 258ff4299da20122d7c387cb8579264035c93c18
Author: Alexey Goncharuk 
Date:   2018-01-31T13:52:24Z

IGNITE-7573 Fixed full API tests to be compliant with baseline topology

commit 254ed3a9c32d092702a0461509bf867cbd7cdee6
Author: Alexey Kuznetsov 
Date:   2018-02-01T08:22:53Z

ignite-2.4.0 Update version.

(cherry picked from commit 2e43749)

commit c1a9c0a404d77fba08170bedf14844f87abe3028
Author: Alexey Goncharuk 
Date:   2018-02-01T10:17:28Z

IGNITE-7569 Fixing index rebuild future

commit e43799ce70cdbe03d9e206381d1d5138b820b075
Author: Alexey Goncharuk 
Date:   2018-02-01T13:39:17Z

IGNITE-7520 Provide util-methods to get baseline from context - Fixes #3431.

commit 8f5fc7cfb0624cf2048efad38dfff32f782116e8
Author: Sergey Chugunov 
Date:   2018-02-02T08:24:29Z

IGNITE-7580 Fix compatibilityMode flag consistency

This closes #3466

(cherry picked from commit 8f2045e)

commit d3ddd50cb2b889173176b6c47c9ff61410e1d909
Author: Ilya Lantukh 
Date:   2018-02-07T10:33:28Z

IGNITE-7514 Affinity assignment should be recalculated when primary node is 
not OWNER

(cherry picked from commit faf50f1)

commit d3745e9d0a3ff5a64fba494889b7e2605f3af6bb
Author: Alexey Goncharuk 
Date:   2018-02-07T18:10:32Z

IGNITE-7639 Fixed NPE

commit f7c16855ba802d9d47048521aec7e14285e4a281
Author: Pavel Kovalenko 
Date:   2018-02-09T13:55:15Z

IGNITE-7540 Prevent page memory metadata corruption during checkpoint and 
group destroying. - Fixes #3490.

Signed-off-by: Alexey Goncharuk 

commit c92f167fc491078f02b9f94fe89edafc2902ebc2
Author: ilantukh 
Date:   2018-02-14T12:40:13Z

Updated version in properties.

commit 1ecf348dd429cf7861b414e0e5a7776b72dba281
Author: Sergey Chugunov 
Date:   2018-02-16T13:21:12Z

IGNITE-7699 BinaryMetadata exchange should not be triggered if metadata was 
not updated - Fixes #3523.

Signed-off-by: Alexey Goncharuk 

(cherry-picked from commit bcd3881)

commit 2458bd08a5b501b3eeb5caf0ae6dcaa2bcccd915
Author: EdShangGG 
Date:   2018-02-16T13:29:49Z

IGNITE-7676 Add affinity version to snapshot plugin stub - Fixes #3510.

Signed-off-by: Alexey Goncharuk 
(cherry picked from commit b6d21fb)

commit bfdcda7a2a6b5cf64f15ed169d2beb886f131fac
Author: EdShangGG 
Date:   2018-02-12T16:36:30Z

IGNITE-7626 Unify code in test which cleans up persistence directories - 
Fixes #3477.

Signed-off-by: Alexey Goncharuk 
(cherry picked from commit a0997b9)

commit 2e92e0094b270aa8489e66d94bfcf15eadabfb4f
Author: EdShangGG 
Date:   2018-02-12T18:44:10Z

IGNITE-7626 Unify code in test which clean up persistence directories - 
Fixes #3512.

Signed-off-by: Alexey Goncharuk 
(cherry picked from commit 6f6f8dd)

commit 3f86c127c78065999663a4fc4eaedb5e5d4bee1c
Author: EdShangGG 
Date:   2018-02-12T18:26:31Z

compilation fix

commit 0b9322c566f9b464291854142ac02495bd1817e4
Author: gg-shq 
Date:   2018-02-07T11:28:04Z

IGNITE-6917: Implemented SQL COPY command.

commit c5e386ca96750213bddcd98d0af0c589fee476ca

[jira] [Commented] (IGNITE-7999) Enhance performance of the thin JDBC streaming mode

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472057#comment-16472057
 ] 

ASF GitHub Bot commented on IGNITE-7999:


Github user asfgit closed the pull request at:

https://github.com/apache/ignite/pull/3789


> Enhance performance of the thin JDBC streaming mode 
> 
>
> Key: IGNITE-7999
> URL: https://issues.apache.org/jira/browse/IGNITE-7999
> Project: Ignite
>  Issue Type: Task
>  Components: jdbc
>Affects Versions: 2.4
>Reporter: Taras Ledkov
>Assignee: Taras Ledkov
>Priority: Major
> Fix For: 2.5
>
> Attachments: Results.html, flamegraph-30.svg
>
>
> Try to enhance thin JDBC performance for streaming mode.
> Waiting for server response takes a lot of time on streaming INSERT.
> Try to skip server response in special mode.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (IGNITE-7999) Enhance performance of the thin JDBC streaming mode

[Taras Ledkov (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432479#comment-16432479
 ] 

Taras Ledkov commented on IGNITE-7999:
--

[~al.psc], [~vozerov], please review the patch.

> Enhance performance of the thin JDBC streaming mode 
> 
>
> Key: IGNITE-7999
> URL: https://issues.apache.org/jira/browse/IGNITE-7999
> Project: Ignite
>  Issue Type: Task
>  Components: jdbc
>Affects Versions: 2.4
>Reporter: Taras Ledkov
>Assignee: Taras Ledkov
>Priority: Major
> Fix For: 2.5
>
> Attachments: Results.html, flamegraph-30.svg
>
>
> Try to enhance thin JDBC performance for streaming mode.
> Waiting for server response takes a lot of time on streaming INSERT.
> Try to skip server response in special mode.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (IGNITE-7999) Enhance performance of the thin JDBC streaming mode

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432387#comment-16432387
 ] 

ASF GitHub Bot commented on IGNITE-7999:


GitHub user tledkov-gridgain opened a pull request:

https://github.com/apache/ignite/pull/3789

IGNITE-7999  Enhance performance of the thin JDBC streaming mode 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/gridgain/apache-ignite ignite-7999

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/ignite/pull/3789.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3789


commit 2082930dd8358196bd2e8a3fabb0f89ac075584d
Author: tledkov-gridgain 
Date:   2018-04-05T15:23:12Z

ignite-7999: save the progress

commit 558cd63fbb85c33ab083d7ee33f9e042bdaabd95
Author: tledkov-gridgain 
Date:   2018-04-06T10:15:36Z

Merge branch '_master' into ignite-7999

commit 2bd9bf43261d6c5707c59de6065f0c300b1bb210
Author: tledkov-gridgain 
Date:   2018-04-06T13:57:13Z

ignite-7999: save the progress

commit 61a3b1a290c4c11f5ec25df1b86e14f4cc650c0e
Author: tledkov-gridgain 
Date:   2018-04-06T15:54:02Z

ignite-7999: save the progress

commit bfa967f81c0d6f02bc5b607de5a9ed7e37a2b918
Author: tledkov-gridgain 
Date:   2018-04-06T16:42:06Z

ignite-7999: save the progress

commit cbc7d18f52d51507a49343dd7ea5b36f87b6f58f
Author: tledkov-gridgain 
Date:   2018-04-09T11:13:42Z

ignite-7999: save the progress

commit 3a3a59ec75469b80bcb0200299b950f0324d5cc6
Author: tledkov-gridgain 
Date:   2018-04-09T11:35:16Z

ignite-7999: save the progress

commit b1f2141b29077ff9e27afcbeb3b2f7ec5a730bcd
Author: tledkov-gridgain 
Date:   2018-04-09T13:14:53Z

Merge branch '_master' into ignite-7999

commit cf04edaa0ae8751c3af6050d636b5b2d9714ceee
Author: tledkov-gridgain 
Date:   2018-04-09T13:31:52Z

ignite-7999: save the progress

commit 19fc8721a35f6145fe0d7aaf4702b9e52e4fb615
Author: tledkov-gridgain 
Date:   2018-04-09T14:08:23Z

Merge branch '_master' into ignite-7999

commit ead3e54df13e3d7d259a05bcdd5a2c7ebb2bebda
Author: tledkov-gridgain 
Date:   2018-04-10T14:35:01Z

ignite-7999: save the progress

commit dd9836d56ada5bf8473b458c7b98378973ab3e22
Author: tledkov-gridgain 
Date:   2018-04-10T14:41:31Z

Merge branch '_master' into ignite-7999




> Enhance performance of the thin JDBC streaming mode 
> 
>
> Key: IGNITE-7999
> URL: https://issues.apache.org/jira/browse/IGNITE-7999
> Project: Ignite
>  Issue Type: Task
>  Components: jdbc
>Affects Versions: 2.4
>Reporter: Taras Ledkov
>Assignee: Taras Ledkov
>Priority: Major
> Fix For: 2.5
>
> Attachments: Results.html, flamegraph-30.svg
>
>
> Try to enhance thin JDBC performance for streaming mode.
> Waiting for server response takes a lot of time on streaming INSERT.
> Try to skip server response in special mode.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (IGNITE-7999) Enhance performance of the thin JDBC streaming mode

[Taras Ledkov (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16430344#comment-16430344
 ] 

Taras Ledkov commented on IGNITE-7999:
--

My proposal: add special streaming mode *ORDERED OFF*, with default value is 
*ON*
When the un-ordered mode is enabled the order of processing batched on an 
Ignite node may be violated because the batch requests are processed 
concurrently. 

I see the performance boost over х5 times for *ORDERED OFF* mode.
Take a look at the attached results of the yardstick benchmark.


> Enhance performance of the thin JDBC streaming mode 
> 
>
> Key: IGNITE-7999
> URL: https://issues.apache.org/jira/browse/IGNITE-7999
> Project: Ignite
>  Issue Type: Task
>  Components: jdbc
>Affects Versions: 2.4
>Reporter: Taras Ledkov
>Assignee: Taras Ledkov
>Priority: Major
> Fix For: 2.5
>
> Attachments: Results.html, flamegraph-30.svg
>
>
> Try to enhance thin JDBC performance for streaming mode.
> Waiting for server response takes a lot of time on streaming INSERT.
> Try to skip server response in special mode.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (IGNITE-7999) Enhance performance of the thin JDBC streaming mode

[Taras Ledkov (JIRA)]

[ 
https://issues.apache.org/jira/browse/IGNITE-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425534#comment-16425534
 ] 

Taras Ledkov commented on IGNITE-7999:
--

Attached flame graph is gathered for streaming prototype without response (only 
one response is sent on the streaming mode off) and server threadpool size = 1. 

> Enhance performance of the thin JDBC streaming mode 
> 
>
> Key: IGNITE-7999
> URL: https://issues.apache.org/jira/browse/IGNITE-7999
> Project: Ignite
>  Issue Type: Task
>  Components: jdbc
>Affects Versions: 2.4
>Reporter: Taras Ledkov
>Assignee: Taras Ledkov
>Priority: Major
> Fix For: 2.5
>
> Attachments: flamegraph-30.svg
>
>
> Try to enhance thin JDBC performance for streaming mode.
> Waiting for server response takes a lot of time on streaming INSERT.
> Try to skip server response in special mode.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)