Re: How to improve the performance of COPY commands?

2019-07-11 Thread Павлухин Иван
Hi,

Currently COPY is a mechanism designed for the fastest data load. Yes,
you can try separate your data in chunks and execute COPY in parallel.
By the way, where is your input located and what is it size in bytes
(Gb)? Is persistence enabled? Does a DataRegion have enough memory to
keep all data?

ср, 10 июл. 2019 г. в 05:02, 18624049226 <18624049...@163.com>:
>
> If the COPY command is used to import a large amount of data, the execution 
> time is a little long.
> In the current test environment, the performance is about more than 10,000/s, 
> so if it is 100 million data, it will take several hours.
>
> Is there a faster way to import, or is COPY working in parallel?
>
> thanks!
>


-- 
Best regards,
Ivan Pavlukhin


Date PartitIon and Jdbc Conneciton Host

2019-07-11 Thread shicheng31...@gmail.com
Hi:
Ignite does not use a master-slave architecture, so when we use sql, we can 
link to any node. If we write data, then the data is partitioned according to 
certain rules, or just write to the node written on JDBC URl?

I have done a test .When I inserted   so many records that the node I 
connected could not bear , then an exception was thrown on the connected node 
because of OOM . And other nodes were all fine . This might show that there was 
no partiton?
 



shicheng31...@gmail.com


Re: JDBC Jar

2019-07-11 Thread Ilya Kasnacheev
Hello!

There's no such command I guess. Maybe there's !tables? Notice the
exclamation mark.

Regards,
-- 
Ilya Kasnacheev


чт, 11 июл. 2019 г. в 20:11, Deepak Nigam :

> Thanks, IIya.
>
> I am trying to see the data tables that my web application has created
> using the sqlline utility. I ran the following command:
>
> ./sqlline.sh --verbose=true -u "jdbc:ignite:thin://127.0.0.1/"
>
> The connection was successful but when I ran 'tables' command, I got the
> following error:
>
>
> Error: Failed to parse query. Syntax error in SQL statement "TABLES[*] ";
> expected "TRUNCATE, {"; SQL statement:
> tables [42001-197] (state=42000,code=1001)
> java.sql.SQLException: Failed to parse query. Syntax error in SQL
> statement "TABLES[*] "; expected "TRUNCATE, {"; SQL statement:
> tables [42001-197]
> at
> org.apache.ignite.internal.jdbc.thin.JdbcThinConnection.sendRequest(JdbcThinConnection.java:750)
> at
> org.apache.ignite.internal.jdbc.thin.JdbcThinStatement.execute0(JdbcThinStatement.java:212)
> at
> org.apache.ignite.internal.jdbc.thin.JdbcThinStatement.execute(JdbcThinStatement.java:475)
> at sqlline.Commands.execute(Commands.java:823)
> at sqlline.Commands.sql(Commands.java:733)
> at sqlline.SqlLine.dispatch(SqlLine.java:795)
> at sqlline.SqlLine.begin(SqlLine.java:668)
> at sqlline.SqlLine.start(SqlLine.java:373)
> at sqlline.SqlLine.main(SqlLine.java:265)
>
> Please let me know if I am missing something.
>
> Thanks in advance!
>
> Regards
> --
> Deepak Nigam
>
>
>
>
>
>
>
> On Thu, Jul 11, 2019 at 10:08 PM Ilya Kasnacheev <
> ilya.kasnach...@gmail.com> wrote:
>
>> Hello!
>>
>> It's ignite-core-2.7.5.jar from libs/ - providing jdbc:ignite:thin://
>> driver
>>
>> Please note that it needs the common Java 9+ args to function.
>>
>> Regards,
>> --
>> Ilya Kasnacheev
>>
>>
>> чт, 11 июл. 2019 г. в 19:17, Deepak Nigam :
>>
>>> Hello all,
>>>
>>> I need to download the jar file for connecting apache ignite with one of
>>> my web application written in Java. I tried to search it on the internet
>>> but unable to find it. Please let me know where I can find it.
>>>
>>>
>>> Regards
>>> --
>>> Deepak Nigam
>>>
>>


Re: JDBC Jar

2019-07-11 Thread Deepak Nigam
Thanks, IIya.

I am trying to see the data tables that my web application has created
using the sqlline utility. I ran the following command:

./sqlline.sh --verbose=true -u "jdbc:ignite:thin://127.0.0.1/"

The connection was successful but when I ran 'tables' command, I got the
following error:


Error: Failed to parse query. Syntax error in SQL statement "TABLES[*] ";
expected "TRUNCATE, {"; SQL statement:
tables [42001-197] (state=42000,code=1001)
java.sql.SQLException: Failed to parse query. Syntax error in SQL statement
"TABLES[*] "; expected "TRUNCATE, {"; SQL statement:
tables [42001-197]
at
org.apache.ignite.internal.jdbc.thin.JdbcThinConnection.sendRequest(JdbcThinConnection.java:750)
at
org.apache.ignite.internal.jdbc.thin.JdbcThinStatement.execute0(JdbcThinStatement.java:212)
at
org.apache.ignite.internal.jdbc.thin.JdbcThinStatement.execute(JdbcThinStatement.java:475)
at sqlline.Commands.execute(Commands.java:823)
at sqlline.Commands.sql(Commands.java:733)
at sqlline.SqlLine.dispatch(SqlLine.java:795)
at sqlline.SqlLine.begin(SqlLine.java:668)
at sqlline.SqlLine.start(SqlLine.java:373)
at sqlline.SqlLine.main(SqlLine.java:265)

Please let me know if I am missing something.

Thanks in advance!

Regards
--
Deepak Nigam







On Thu, Jul 11, 2019 at 10:08 PM Ilya Kasnacheev 
wrote:

> Hello!
>
> It's ignite-core-2.7.5.jar from libs/ - providing jdbc:ignite:thin://
> driver
>
> Please note that it needs the common Java 9+ args to function.
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> чт, 11 июл. 2019 г. в 19:17, Deepak Nigam :
>
>> Hello all,
>>
>> I need to download the jar file for connecting apache ignite with one of
>> my web application written in Java. I tried to search it on the internet
>> but unable to find it. Please let me know where I can find it.
>>
>>
>> Regards
>> --
>> Deepak Nigam
>>
>


Re: JDBC Jar

2019-07-11 Thread Ilya Kasnacheev
Hello!

It's ignite-core-2.7.5.jar from libs/ - providing jdbc:ignite:thin:// driver

Please note that it needs the common Java 9+ args to function.

Regards,
-- 
Ilya Kasnacheev


чт, 11 июл. 2019 г. в 19:17, Deepak Nigam :

> Hello all,
>
> I need to download the jar file for connecting apache ignite with one of
> my web application written in Java. I tried to search it on the internet
> but unable to find it. Please let me know where I can find it.
>
>
> Regards
> --
> Deepak Nigam
>


JDBC Jar

2019-07-11 Thread Deepak Nigam
Hello all,

I need to download the jar file for connecting apache ignite with one of my
web application written in Java. I tried to search it on the internet but
unable to find it. Please let me know where I can find it.


Regards
--
Deepak Nigam