[jira] [Commented] (IGNITE-4169) Data streamer mode for DML

2017-03-01 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/IGNITE-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890280#comment-15890280
 ] 

ASF GitHub Bot commented on IGNITE-4169:


Github user asfgit closed the pull request at:

https://github.com/apache/ignite/pull/1553


> Data streamer mode for DML
> --
>
> Key: IGNITE-4169
> URL: https://issues.apache.org/jira/browse/IGNITE-4169
> Project: Ignite
>  Issue Type: New Feature
>  Components: SQL
>Affects Versions: 1.8
>Reporter: Alexander Paschenko
>Assignee: Alexander Paschenko
> Fix For: 1.9
>
>
> SQL INSERT and MERGE are supposed to support data streamer mode which should 
> be turned on by JDBC connection string param.
> Note: particular details of usage means and implementation of this mode, as 
> well as urgency of this feature are yet to be discussed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (IGNITE-4169) Data streamer mode for DML

2017-02-17 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/IGNITE-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15872169#comment-15872169
 ] 

ASF GitHub Bot commented on IGNITE-4169:


Github user alexpaschenko closed the pull request at:

https://github.com/apache/ignite/pull/1350


> Data streamer mode for DML
> --
>
> Key: IGNITE-4169
> URL: https://issues.apache.org/jira/browse/IGNITE-4169
> Project: Ignite
>  Issue Type: New Feature
>  Components: SQL
>Affects Versions: 1.8
>Reporter: Alexander Paschenko
>Assignee: Alexander Paschenko
> Fix For: 1.9
>
>
> SQL INSERT and MERGE are supposed to support data streamer mode which should 
> be turned on by JDBC connection string param.
> Note: particular details of usage means and implementation of this mode, as 
> well as urgency of this feature are yet to be discussed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (IGNITE-4169) Data streamer mode for DML

2017-02-17 Thread Alexander Paschenko (JIRA) 

[ 
https://issues.apache.org/jira/browse/IGNITE-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15872141#comment-15872141
 ] 

Alexander Paschenko commented on IGNITE-4169:
-

To allow for correct merge, I've made another branch that contains only 
relevant changes that is ready to roll upon ignite-1.9.
Branch name is *ignite-4169-to-1.9*, github PR is 
https://github.com/apache/ignite/pull/1553.
Branch contains per Vlad's request no batching capabilities, only streamed 
{{INSERT}} s stuff.

> Data streamer mode for DML
> --
>
> Key: IGNITE-4169
> URL: https://issues.apache.org/jira/browse/IGNITE-4169
> Project: Ignite
>  Issue Type: New Feature
>  Components: SQL
>Affects Versions: 1.8
>Reporter: Alexander Paschenko
>Assignee: Alexander Paschenko
> Fix For: 1.9
>
>
> SQL INSERT and MERGE are supposed to support data streamer mode which should 
> be turned on by JDBC connection string param.
> Note: particular details of usage means and implementation of this mode, as 
> well as urgency of this feature are yet to be discussed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (IGNITE-4169) Data streamer mode for DML

2017-02-17 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/IGNITE-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15872124#comment-15872124
 ] 

ASF GitHub Bot commented on IGNITE-4169:


GitHub user alexpaschenko opened a pull request:

https://github.com/apache/ignite/pull/1553

IGNITE-4169 Streamed SQL INSERTs



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/gridgain/apache-ignite ignite-4169-to-1.9

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/ignite/pull/1553.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1553


commit b46b15f5b417654c0f9c1ecb87243178e6353547
Author: Alexander Paschenko 
Date:   2017-02-17T17:06:16Z

IGNITE-4169 Streamed SQL INSERTs




> Data streamer mode for DML
> --
>
> Key: IGNITE-4169
> URL: https://issues.apache.org/jira/browse/IGNITE-4169
> Project: Ignite
>  Issue Type: New Feature
>  Components: SQL
>Affects Versions: 1.8
>Reporter: Alexander Paschenko
>Assignee: Alexander Paschenko
> Fix For: 1.9
>
>
> SQL INSERT and MERGE are supposed to support data streamer mode which should 
> be turned on by JDBC connection string param.
> Note: particular details of usage means and implementation of this mode, as 
> well as urgency of this feature are yet to be discussed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (IGNITE-4169) Data streamer mode for DML

2016-12-23 Thread Denis Magda (JIRA) 

[ 
https://issues.apache.org/jira/browse/IGNITE-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15773540#comment-15773540
 ] 

Denis Magda commented on IGNITE-4169:
-

[~al.psc], let's handle the doc as a part of this ticket as well. @[~vozerov], 
assign the ticket on me once you've finished with the review.

> Data streamer mode for DML
> --
>
> Key: IGNITE-4169
> URL: https://issues.apache.org/jira/browse/IGNITE-4169
> Project: Ignite
>  Issue Type: New Feature
>  Components: SQL
>Affects Versions: 1.8
>Reporter: Alexander Paschenko
>Assignee: Vladimir Ozerov
> Fix For: 2.0
>
>
> SQL INSERT and MERGE are supposed to support data streamer mode which should 
> be turned on by JDBC connection string param.
> Note: particular details of usage means and implementation of this mode, as 
> well as urgency of this feature are yet to be discussed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (IGNITE-4169) Data streamer mode for DML

2016-12-23 Thread Alexander Paschenko (JIRA) 

[ 
https://issues.apache.org/jira/browse/IGNITE-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15773160#comment-15773160
 ] 

Alexander Paschenko commented on IGNITE-4169:
-

[~dmagda],

Should the issue be re-assigned to you after Vlad has reviewed it? Probably it 
would be better to just create new issue for docs, wouldn't it? All in all, 
I've implemented it 2 days ago.

> Data streamer mode for DML
> --
>
> Key: IGNITE-4169
> URL: https://issues.apache.org/jira/browse/IGNITE-4169
> Project: Ignite
>  Issue Type: New Feature
>  Components: SQL
>Affects Versions: 1.8
>Reporter: Alexander Paschenko
>Assignee: Vladimir Ozerov
> Fix For: 2.0
>
>
> SQL INSERT and MERGE are supposed to support data streamer mode which should 
> be turned on by JDBC connection string param.
> Note: particular details of usage means and implementation of this mode, as 
> well as urgency of this feature are yet to be discussed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (IGNITE-4169) Data streamer mode for DML

2016-12-20 Thread Denis Magda (JIRA) 

[ 
https://issues.apache.org/jira/browse/IGNITE-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765170#comment-15765170
 ] 

Denis Magda commented on IGNITE-4169:
-

[~al.psc], please assign the ticket to me once you're done with it. I'll 
document the new parameters usage on the DML page. Presently we shouldn't 
modify it because I've not finished with its review yet. Will do this week.

> Data streamer mode for DML
> --
>
> Key: IGNITE-4169
> URL: https://issues.apache.org/jira/browse/IGNITE-4169
> Project: Ignite
>  Issue Type: New Feature
>  Components: SQL
>Affects Versions: 1.8
>Reporter: Alexander Paschenko
>Assignee: Vladimir Ozerov
> Fix For: 2.0
>
>
> SQL INSERT and MERGE are supposed to support data streamer mode which should 
> be turned on by JDBC connection string param.
> Note: particular details of usage means and implementation of this mode, as 
> well as urgency of this feature are yet to be discussed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (IGNITE-4169) Data streamer mode for DML

2016-12-20 Thread Alexander Paschenko (JIRA) 

[ 
https://issues.apache.org/jira/browse/IGNITE-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15764852#comment-15764852
 ] 

Alexander Paschenko commented on IGNITE-4169:
-

Per recommendation from [~dmagda] on dev list, added params for per node buffer 
size and parallel ops count. Working on example for streamed SQL INSERTs.

> Data streamer mode for DML
> --
>
> Key: IGNITE-4169
> URL: https://issues.apache.org/jira/browse/IGNITE-4169
> Project: Ignite
>  Issue Type: New Feature
>  Components: SQL
>Affects Versions: 1.8
>Reporter: Alexander Paschenko
>Assignee: Vladimir Ozerov
> Fix For: 2.0
>
>
> SQL INSERT and MERGE are supposed to support data streamer mode which should 
> be turned on by JDBC connection string param.
> Note: particular details of usage means and implementation of this mode, as 
> well as urgency of this feature are yet to be discussed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (IGNITE-4169) Data streamer mode for DML

2016-12-19 Thread Alexander Paschenko (JIRA) 

[ 
https://issues.apache.org/jira/browse/IGNITE-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761485#comment-15761485
 ] 

Alexander Paschenko commented on IGNITE-4169:
-

Issue fixed, patch available. Implementation conforms to what has been 
discussed on dev list regarding this matter.

How it works:

* streaming mode is turned on via connection string property/explicitly by 
setting property in {{Properties}} object given to driver when requesting a 
connection from it. Property name is {{ignite.jdbc.stream}}

* streaming works for {{PreparedStatements}}, and it makes sense as typical 
workflow is to create the statement/streamer once, and then just feed data to 
it.

* streaming works only for "local" connections - i.e. ones without {{nodeId}} 
prop set in connection settings. It makes sense as the whole point of data 
streamer is achieving maximum performance, and we would lose the benefits of 
using it if we sent streaming arguments over network. In this local mode, 
streamer receives its key-value pairs in direct and simple manner.

* operations supported in streamed prepared statements are:
** rows based MERGE and INSERT (no subqeries)
** key bounded UPDATE and DELETE (ones with condition of kind {{WHERE _key = 
?}}, where key is a constant or parameter)
Required operations semantic is maintained via {{StreamReceiver}} s associated 
with streamers.

* Data streamer objects are associated with prepared statements. A streamer is 
created with the statement and is closed (flushing pending data on the way) 
when the statement is closed.

* Semantic of queries (non DML operations) is retained - if, for some reason, 
the user creates a {{PreparedStatement}} from SQL SELECT, it will work as if 
streaming hasn't been turned on.

* If the user attempts to execute a streamed {{PreparedStatement}} in batched 
manner (IGNITE-4269), it will work. The only difference with non batched mode 
will be just that the streamer gets all batch at once - in other words, JDBC 
batching affects only data chunk size that streamer gets at once.

> Data streamer mode for DML
> --
>
> Key: IGNITE-4169
> URL: https://issues.apache.org/jira/browse/IGNITE-4169
> Project: Ignite
>  Issue Type: New Feature
>  Components: SQL
>Reporter: Alexander Paschenko
>Assignee: Vladimir Ozerov
> Fix For: 1.8
>
>
> SQL INSERT and MERGE are supposed to support data streamer mode which should 
> be turned on by JDBC connection string param.
> Note: particular details of usage means and implementation of this mode, as 
> well as urgency of this feature are yet to be discussed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (IGNITE-4169) Data streamer mode for DML

2016-12-15 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/IGNITE-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15751654#comment-15751654
 ] 

ASF GitHub Bot commented on IGNITE-4169:


GitHub user alexpaschenko opened a pull request:

https://github.com/apache/ignite/pull/1350

IGNITE-4169 DML integration w/data streamer



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/gridgain/apache-ignite ignite-4169

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/ignite/pull/1350.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1350


commit 761223d285ff6faffa23b4e111ec631cd9a156c7
Author: Alexander Paschenko 
Date:   2016-12-15T15:30:12Z

IGNITE-4169 DML integration w/data streamer




> Data streamer mode for DML
> --
>
> Key: IGNITE-4169
> URL: https://issues.apache.org/jira/browse/IGNITE-4169
> Project: Ignite
>  Issue Type: Sub-task
>  Components: SQL
>Reporter: Alexander Paschenko
>Assignee: Alexander Paschenko
> Fix For: 1.8
>
>
> SQL INSERT and MERGE are supposed to support data streamer mode which should 
> be turned on by JDBC connection string param.
> Note: particular details of usage means and implementation of this mode, as 
> well as urgency of this feature are yet to be discussed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (IGNITE-4169) Data streamer mode for DML

2016-12-12 Thread Alexander Paschenko (JIRA) 

[ 
https://issues.apache.org/jira/browse/IGNITE-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15742342#comment-15742342
 ] 

Alexander Paschenko commented on IGNITE-4169:
-

Work on this issue has been resumed in the course of work on DML after its 
initial release.
Implementation suggestions by [~dsetrakyan] are here:
http://apache-ignite-developers.2346864.n4.nabble.com/Batch-DML-queries-design-discussion-td12859.html

In short: this mode should work independently from JDBC batching; should be 
turned on via connection flag; should support INSERT, MERGE, and fast UPDATE.

> Data streamer mode for DML
> --
>
> Key: IGNITE-4169
> URL: https://issues.apache.org/jira/browse/IGNITE-4169
> Project: Ignite
>  Issue Type: Sub-task
>  Components: SQL
>Reporter: Alexander Paschenko
>Assignee: Alexander Paschenko
> Fix For: 1.8
>
>
> SQL INSERT and MERGE are supposed to support data streamer mode which should 
> be turned on by JDBC connection string param.
> Note: particular details of usage means and implementation of this mode, as 
> well as urgency of this feature are yet to be discussed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)