Re: Control.sh command that schedules index rebuild in the maintenance mode

[Данилов Семён]

Hello, Nikolay!

Online rebuild causes unpredictable behaviour of the indexed SQL queries. For 
example, if a query plan requires an index scan, we will instead resort to the 
full scan which is unacceptable for some users. So sometimes it’s better to 
shutdown the node than mess up the application.

Kind regards, Semyon.

> Hello, Семен.
> 
> Why index rebuild should be done in maintenance mode?
> 
>> 31 мая 2022 г., в 18:24, Данилов Семён  написал(а):
>>
>> Hello, igniters!
>>
>> I want to propose a new control.sh cache sub-command that schedules a 
>> rebuild of cache indexes in the maintenance mode.
>> We already have a force rebuild command but sometimes (for example, under 
>> load) user may want to first stop the node and then rebuild indexes.
>> For this scenario we can add a command that creates a maintenance task and 
>> then after restart node will enter the maintenance mode and rebuild 
>> specified indexes.
>>
>> I propose the following API:
>> --cache schedule_indexes_rebuild --node-id nodeId --target 
>> cacheName1=index1,...indexN
>> Schedules rebuild of the indexes for specified caches via the Maintenance 
>> Mode.
>>
>> Parameters:
>> --node-id - (Optional) Specify node for indexes rebuild.
>> --target - Cache name with optionally specified indexes. If indexes are not 
>> specified then all indexes of the cache will be scheduled for the rebuild 
>> operation.
>>
>> As you can see, the user can provide a node id to schedule the rebuild on a 
>> specific node (otherwise the rebuild will be scheduled for all of the nodes) 
>> and targets (specific indexes of a cache or all of the indexes of a cache).
>> There is a ticket[1] and a pull request[2] for my proposal.
>>
>> WDYT?
>>
>> Kind regards,
>> Semyon.
>>
>> [1] https://issues.apache.org/jira/browse/IGNITE-17002
>> [2] https://github.com/apache/ignite/pull/10042

Re: Control.sh command that schedules index rebuild in the maintenance mode

[Николай Ижиков]

Hello, Семен.

Why index rebuild should be done in maintenance mode?

> 31 мая 2022 г., в 18:24, Данилов Семён  написал(а):
> 
> Hello, igniters!
> 
> I want to propose a new control.sh cache sub-command that schedules a rebuild 
> of cache indexes in the maintenance mode. 
> We already have a force rebuild command but sometimes (for example, under 
> load) user may want to first stop the node and then rebuild indexes.
> For this scenario we can add a command that creates a maintenance task and 
> then after restart node will enter the maintenance mode and rebuild specified 
> indexes.
> 
> I propose the following API:
> --cache schedule_indexes_rebuild --node-id nodeId --target 
> cacheName1=index1,...indexN
> Schedules rebuild of the indexes for specified caches via the Maintenance 
> Mode.
> 
> Parameters:
>--node-id - (Optional) Specify node for indexes rebuild.
>--target- Cache name with optionally specified indexes. If indexes 
> are not specified then all indexes of the cache will be scheduled for the 
> rebuild operation.
> 
> As you can see, the user can provide a node id to schedule the rebuild on a 
> specific node (otherwise the rebuild will be scheduled for all of the nodes) 
> and targets (specific indexes of a cache or all of the indexes of a cache).
> There is a ticket[1] and a pull request[2] for my proposal.
> 
> WDYT?
> 
> Kind regards,
> Semyon.
> 
> [1] https://issues.apache.org/jira/browse/IGNITE-17002
> [2] https://github.com/apache/ignite/pull/10042
> 

Control.sh command that schedules index rebuild in the maintenance mode

[Данилов Семён]

Hello, igniters!

I want to propose a new control.sh cache sub-command that schedules a rebuild 
of cache indexes in the maintenance mode. 
We already have a force rebuild command but sometimes (for example, under load) 
user may want to first stop the node and then rebuild indexes.
For this scenario we can add a command that creates a maintenance task and then 
after restart node will enter the maintenance mode and rebuild specified 
indexes.

I propose the following API:
--cache schedule_indexes_rebuild --node-id nodeId --target 
cacheName1=index1,...indexN
 Schedules rebuild of the indexes for specified caches via the Maintenance 
Mode.

 Parameters:
--node-id - (Optional) Specify node for indexes rebuild.
--target- Cache name with optionally specified indexes. If indexes 
are not specified then all indexes of the cache will be scheduled for the 
rebuild operation.

As you can see, the user can provide a node id to schedule the rebuild on a 
specific node (otherwise the rebuild will be scheduled for all of the nodes) 
and targets (specific indexes of a cache or all of the indexes of a cache).
There is a ticket[1] and a pull request[2] for my proposal.

WDYT?

Kind regards,
Semyon.

[1] https://issues.apache.org/jira/browse/IGNITE-17002
[2] https://github.com/apache/ignite/pull/10042

Re: [VOTE] Add micronaut dependency to Ignite 3 (reopened)

[Aleksandr Pakhomov]

Alexander,

I am not sure that now we can define all 
security standards that will be implemented
by Ignite 3. But I can mention the most popular:
OAuth2/OpenId, LDAP. 

I’ve mentioned them in IEP but I believe that
the definite set of security protocols has to
be discussed in another IEP.

> On 30 May 2022, at 12:13, Alexander Polovtcev  wrote:
> 
> Aleksandr,
> Thanks for the update, but can you please explain what security
> capabilities are planned to be used? Maybe it should be included in the IEP
> as well.
> 
> On Sun, May 29, 2022 at 11:03 PM Aleksandr Pakhomov  >
> wrote:
> 
>> Dear community,
>> 
>> We’ve had a productive discussion about
>> a micronaut dependency [1]. As a result,
>> we’ve came to the conclusion that the
>> security support in micronaut is a good
>> reason to use this library. I am reopening the
>> vote for adding the micronaut dependency to
>> the rest module. Also, micronaut-serde is
>> dropped from the list because Ignite 3
>> already uses jackson as a serialisation lib.
>> 
>> List of dependencies:
>> io.micronaut:micronaut-inject:jar:3.4.1
>> io.micronaut:micronaut-core:jar:3.4.1
>> io.micronaut:micronaut-http-server-netty:jar:3.4.1
>> io.micronaut:micronaut-http-server:jar:3.4.1
>> io.micronaut:micronaut-router:jar:3.4.1
>> io.micronaut:micronaut-http-netty:jar:3.4.1
>> io.micronaut:micronaut-buffer-netty:jar:3.4.1
>> io.micronaut:micronaut-runtime:jar:3.4.1
>> io.micronaut:micronaut-http:jar:3.4.1
>> io.micronaut:micronaut-aop:jar:3.4.1
>> io.micronaut:micronaut-context:jar:3.4.1
>> io.micronaut:micronaut-core-reactive:jar:3.4.1
>> 
>> More information about motivation and
>> implementation details could be found
>> in IEP-87 [2].
>> 
>> The vote is formal, see voting guidelines [3].
>> 
>> +1 - to accept additional dependencies to be included to Java code
>> Guidelines [4]
>> 0 - don’t care either way
>> -1 - DO NOT accept (explain why)
>> 
>> This vote will be open for at leas 3 days till Wed June 1, 2022,
>> 23:00 Moscow TZ [5].
>> 
>> 
>> [1] https://lists.apache.org/thread/0nq6wx8t9r036mrjsk6n592gwnvvqbhs <
>> https://lists.apache.org/thread/0nq6wx8t9r036mrjsk6n592gwnvvqbhs 
>> >
>> [2]
>> https://cwiki.apache.org/confluence/display/IGNITE/IEP-87%3A+Open+API+support+for+REST
>>  
>> 
>> <
>> https://cwiki.apache.org/confluence/display/IGNITE/IEP-87:+Open+API+support+for+REST
>>  
>> >
>> 
>> [3] https://www.apache.org/foundation/voting.html 
>>  <
>> https://www.apache.org/foundation/voting.html 
>> >
>> [4]
>> https://cwiki.apache.org/confluence/display/IGNITE/Java+Code+Style+Guide#JavaCodeStyleGuide-2Using3rdpartylibraries
>>  
>> 
>> <
>> https://cwiki.apache.org/confluence/display/IGNITE/Java+Code+Style+Guide#JavaCodeStyleGuide-2Using3rdpartylibraries
>>  
>> 
>>> 
>> [5]
>> https://www.timeanddate.com/countdown/generic?iso=20220601T23&p0=166&msg=%5BVOTE%5D+Add+micronaut+dependency+to+Ignite+3+%28reopened%29&font=cursive
>>  
>> 
>> <
>> https://www.timeanddate.com/countdown/generic?iso=20220601T23&p0=166&msg=[VOTE]+Add+micronaut+dependency+to+Ignite+3+(reopened)&font=cursive
>>  
>> >
>> 
> 
> 
> 
> -- 
> With regards,
> Aleksandr Polovtcev

Re: [RESULT][VOTE] Add swagger dependency to Ignite 3

[Aleksandr Pakhomov]

Andrey,

Thanks, done.

> On 31 May 2022, at 11:36, Andrey Gura  wrote:
> 
> Aleksandr,
> 
> could you please update
> https://cwiki.apache.org/confluence/display/IGNITE/Java+Code+Style+Guide#JavaCodeStyleGuide-2Using3rdpartylibraries
>  
> 
> 
> On Mon, May 30, 2022 at 12:33 PM Aleksandr Pakhomov  > wrote:
>> 
>> Hello Igniters,
>> 
>> The swagger dependency has been accepted.
>> 
>> 3 - “+1” votes received.
>> 1 - “0.5” vote received.
>> 
>> Here are +1 votes received:
>> 
>> - Alexander Polovtcev
>> - Andrey Gura
>> - Ivan Pavlukhin
>> 
>> Here is -0.5 vote received:
>> 
>> - Ilya Kasnacheev (binding)
>> 
>> Link to the voting thread -
>> https://lists.apache.org/thread/dntnxcyzpddjg5yc5vkd8lxjtd5z54rc 
>>  
>> > >
>> 
>> Best regards,
>> Aleksandr

Re: [RESULT][VOTE] Add swagger dependency to Ignite 3

[Andrey Gura]

Aleksandr,

could you please update
https://cwiki.apache.org/confluence/display/IGNITE/Java+Code+Style+Guide#JavaCodeStyleGuide-2Using3rdpartylibraries

On Mon, May 30, 2022 at 12:33 PM Aleksandr Pakhomov  wrote:
>
> Hello Igniters,
>
> The swagger dependency has been accepted.
>
> 3 - “+1” votes received.
> 1 - “0.5” vote received.
>
> Here are +1 votes received:
>
> - Alexander Polovtcev
> - Andrey Gura
> - Ivan Pavlukhin
>
> Here is -0.5 vote received:
>
> - Ilya Kasnacheev (binding)
>
> Link to the voting thread -
> https://lists.apache.org/thread/dntnxcyzpddjg5yc5vkd8lxjtd5z54rc 
> 
>
> Best regards,
> Aleksandr

Re: [VOTE] Add micronaut dependency to Ignite 3 (reopened)

[Andrey Gura]

+1

On Mon, May 30, 2022 at 12:13 PM Alexander Polovtcev
 wrote:
>
> Aleksandr,
> Thanks for the update, but can you please explain what security
> capabilities are planned to be used? Maybe it should be included in the IEP
> as well.
>
> On Sun, May 29, 2022 at 11:03 PM Aleksandr Pakhomov 
> wrote:
>
> > Dear community,
> >
> > We’ve had a productive discussion about
> > a micronaut dependency [1]. As a result,
> > we’ve came to the conclusion that the
> > security support in micronaut is a good
> > reason to use this library. I am reopening the
> > vote for adding the micronaut dependency to
> > the rest module. Also, micronaut-serde is
> > dropped from the list because Ignite 3
> > already uses jackson as a serialisation lib.
> >
> > List of dependencies:
> > io.micronaut:micronaut-inject:jar:3.4.1
> > io.micronaut:micronaut-core:jar:3.4.1
> > io.micronaut:micronaut-http-server-netty:jar:3.4.1
> > io.micronaut:micronaut-http-server:jar:3.4.1
> > io.micronaut:micronaut-router:jar:3.4.1
> > io.micronaut:micronaut-http-netty:jar:3.4.1
> > io.micronaut:micronaut-buffer-netty:jar:3.4.1
> > io.micronaut:micronaut-runtime:jar:3.4.1
> > io.micronaut:micronaut-http:jar:3.4.1
> > io.micronaut:micronaut-aop:jar:3.4.1
> > io.micronaut:micronaut-context:jar:3.4.1
> > io.micronaut:micronaut-core-reactive:jar:3.4.1
> >
> > More information about motivation and
> > implementation details could be found
> > in IEP-87 [2].
> >
> > The vote is formal, see voting guidelines [3].
> >
> > +1 - to accept additional dependencies to be included to Java code
> > Guidelines [4]
> > 0 - don’t care either way
> > -1 - DO NOT accept (explain why)
> >
> > This vote will be open for at leas 3 days till Wed June 1, 2022,
> > 23:00 Moscow TZ [5].
> >
> >
> > [1] https://lists.apache.org/thread/0nq6wx8t9r036mrjsk6n592gwnvvqbhs <
> > https://lists.apache.org/thread/0nq6wx8t9r036mrjsk6n592gwnvvqbhs>
> > [2]
> > https://cwiki.apache.org/confluence/display/IGNITE/IEP-87%3A+Open+API+support+for+REST
> > <
> > https://cwiki.apache.org/confluence/display/IGNITE/IEP-87:+Open+API+support+for+REST>
> >
> > [3] https://www.apache.org/foundation/voting.html <
> > https://www.apache.org/foundation/voting.html>
> > [4]
> > https://cwiki.apache.org/confluence/display/IGNITE/Java+Code+Style+Guide#JavaCodeStyleGuide-2Using3rdpartylibraries
> > <
> > https://cwiki.apache.org/confluence/display/IGNITE/Java+Code+Style+Guide#JavaCodeStyleGuide-2Using3rdpartylibraries
> > >
> > [5]
> > https://www.timeanddate.com/countdown/generic?iso=20220601T23&p0=166&msg=%5BVOTE%5D+Add+micronaut+dependency+to+Ignite+3+%28reopened%29&font=cursive
> > <
> > https://www.timeanddate.com/countdown/generic?iso=20220601T23&p0=166&msg=[VOTE]+Add+micronaut+dependency+to+Ignite+3+(reopened)&font=cursive>
> >
>
>
>
> --
> With regards,
> Aleksandr Polovtcev