[jira] [Assigned] (IGNITE-7051) SQL Rename table support
[ https://issues.apache.org/jira/browse/IGNITE-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy Setrakyan reassigned IGNITE-7051: - Assignee: Vladimir Ozerov > SQL Rename table support > > > Key: IGNITE-7051 > URL: https://issues.apache.org/jira/browse/IGNITE-7051 > Project: Ignite > Issue Type: Improvement > Components: sql >Affects Versions: 2.3 >Reporter: Blackfield >Assignee: Vladimir Ozerov > > Use case was discussed at length here: > http://apache-ignite-users.70518.x6.nabble.com/Continuous-update-Data-Grid-Cache-td2075.html#a17641 > Currently, we have to load data to second table, the client then has to > change their query to query this > new table. Drop the old table. > The latest suggestion in the above thread to "load new data set in the same > cache and remove old entries once preloading is finished" is not feasible > since for large table and table scan query (thus requires whole dataset to > be loaded), it will take a while to load everything - thus increasing the > downtime. > Table rename support will reduce the downtime greatly. > Ref: Postgresql and H2 syntax > ALTER TABLE TmpTable RENAME TO Table1; > Then, one would wrap it within transaction (It appears that this is slated > for 2.4/2.5?) to drop old table, rename temp table to original table. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-6999) Add a flag for Visor batch mode to output only command results without additional info.
[ https://issues.apache.org/jira/browse/IGNITE-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283152#comment-16283152 ] Pavel Konstantinov commented on IGNITE-6999: Tested. > Add a flag for Visor batch mode to output only command results without > additional info. > --- > > Key: IGNITE-6999 > URL: https://issues.apache.org/jira/browse/IGNITE-6999 > Project: Ignite > Issue Type: New Feature > Components: visor >Affects Versions: 2.1 >Reporter: Alexandr Fedotov >Assignee: Pavel Konstantinov > Fix For: 2.4 > > > Currently, in batch mode, Visor Command Line simply run supplied commands one > by one as if they were entered from the keyboard which results in a quite > verbose output. > A new flag should be introduced like {{--silent}} to suppress additional info > output and left only output related directly to the executed commands. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-7145) Visor CMD: Fix tests for: Ignite Visor Console
[ https://issues.apache.org/jira/browse/IGNITE-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasiliy Sisko reassigned IGNITE-7145: - Assignee: Pavel Konstantinov (was: Alexey Kuznetsov) > Visor CMD: Fix tests for: Ignite Visor Console > -- > > Key: IGNITE-7145 > URL: https://issues.apache.org/jira/browse/IGNITE-7145 > Project: Ignite > Issue Type: Test >Reporter: Vasiliy Sisko >Assignee: Pavel Konstantinov > > https://ci.ignite.apache.org/viewLog.html?buildId=984720=buildResultsDiv=Ignite20Tests_IgniteVisorConsoleTestDetach -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-7145) Visor CMD: Fix tests for: Ignite Visor Console
[ https://issues.apache.org/jira/browse/IGNITE-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasiliy Sisko reassigned IGNITE-7145: - Assignee: Alexey Kuznetsov (was: Vasiliy Sisko) Test fixed. See 3177 pull request. > Visor CMD: Fix tests for: Ignite Visor Console > -- > > Key: IGNITE-7145 > URL: https://issues.apache.org/jira/browse/IGNITE-7145 > Project: Ignite > Issue Type: Test >Reporter: Vasiliy Sisko >Assignee: Alexey Kuznetsov > > https://ci.ignite.apache.org/viewLog.html?buildId=984720=buildResultsDiv=Ignite20Tests_IgniteVisorConsoleTestDetach -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-6999) Add a flag for Visor batch mode to output only command results without additional info.
[ https://issues.apache.org/jira/browse/IGNITE-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasiliy Sisko reassigned IGNITE-6999: - Assignee: Pavel Konstantinov (was: Vasiliy Sisko) > Add a flag for Visor batch mode to output only command results without > additional info. > --- > > Key: IGNITE-6999 > URL: https://issues.apache.org/jira/browse/IGNITE-6999 > Project: Ignite > Issue Type: New Feature > Components: visor >Affects Versions: 2.1 >Reporter: Alexandr Fedotov >Assignee: Pavel Konstantinov > Fix For: 2.4 > > > Currently, in batch mode, Visor Command Line simply run supplied commands one > by one as if they were entered from the keyboard which results in a quite > verbose output. > A new flag should be introduced like {{--silent}} to suppress additional info > output and left only output related directly to the executed commands. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-6999) Add a flag for Visor batch mode to output only command results without additional info.
[ https://issues.apache.org/jira/browse/IGNITE-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283127#comment-16283127 ] Vasiliy Sisko commented on IGNITE-6999: --- Fixed. > Add a flag for Visor batch mode to output only command results without > additional info. > --- > > Key: IGNITE-6999 > URL: https://issues.apache.org/jira/browse/IGNITE-6999 > Project: Ignite > Issue Type: New Feature > Components: visor >Affects Versions: 2.1 >Reporter: Alexandr Fedotov >Assignee: Vasiliy Sisko > Fix For: 2.4 > > > Currently, in batch mode, Visor Command Line simply run supplied commands one > by one as if they were entered from the keyboard which results in a quite > verbose output. > A new flag should be introduced like {{--silent}} to suppress additional info > output and left only output related directly to the executed commands. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-6976) Visor CMD: Add ability to put/get/remove data to caches via command line Visor.
[ https://issues.apache.org/jira/browse/IGNITE-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Konstantinov reassigned IGNITE-6976: -- Assignee: Vasiliy Sisko (was: Pavel Konstantinov) > Visor CMD: Add ability to put/get/remove data to caches via command line > Visor. > --- > > Key: IGNITE-6976 > URL: https://issues.apache.org/jira/browse/IGNITE-6976 > Project: Ignite > Issue Type: Improvement > Components: wizards >Reporter: Alexey Kuznetsov >Assignee: Vasiliy Sisko > Fix For: 2.4 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7145) Visor CMD: Fix tests for: Ignite Visor Console
[ https://issues.apache.org/jira/browse/IGNITE-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283120#comment-16283120 ] ASF GitHub Bot commented on IGNITE-7145: GitHub user vsisko opened a pull request: https://github.com/apache/ignite/pull/3177 IGNITE-7145 Fixed print of warning message. You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-7145 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/ignite/pull/3177.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3177 commit 6be9a94c82884e7fd8620795281fcb8cc4b05600 Author: vsiskoDate: 2017-12-08T03:32:48Z IGNITE-7145 Fixed print of warning message. > Visor CMD: Fix tests for: Ignite Visor Console > -- > > Key: IGNITE-7145 > URL: https://issues.apache.org/jira/browse/IGNITE-7145 > Project: Ignite > Issue Type: Test >Reporter: Vasiliy Sisko >Assignee: Vasiliy Sisko > > https://ci.ignite.apache.org/viewLog.html?buildId=984720=buildResultsDiv=Ignite20Tests_IgniteVisorConsoleTestDetach -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7112) Non informative "Failed to wait for partition map exchange" message.
[ https://issues.apache.org/jira/browse/IGNITE-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283090#comment-16283090 ] Stanilovsky Evgeny commented on IGNITE-7112: this fix partially consist in https://github.com/apache/ignite/pull/3175, if 3175 will be merged, no need in this fix. > Non informative "Failed to wait for partition map exchange" message. > > > Key: IGNITE-7112 > URL: https://issues.apache.org/jira/browse/IGNITE-7112 > Project: Ignite > Issue Type: Bug >Affects Versions: 2.3 >Reporter: Stanilovsky Evgeny >Assignee: Semen Boikov >Priority: Minor > Fix For: 2.4 > > > Eventually can be observed "Failed to wait for partition map exchange" with > no further detalization info, due to code below. > {code:java} > final long futTimeout = 2 * cctx.gridConfig().getNetworkTimeout(); > long nextDumpTime = 0; > while (true) { > try { > resVer = exchFut.get(futTimeout, TimeUnit.MILLISECONDS); > break; > } > catch (IgniteFutureTimeoutCheckedException ignored) { > U.warn(diagnosticLog, "Failed to wait for partition map exchange [" + > ... > if (nextDumpTime <= U.currentTimeMillis()) { > try { > dumpDebugInfo(exchFut); > } > catch (Exception e) { > U.error(diagnosticLog, "Failed to dump debug information: " + e, e); > } > nextDumpTime = U.currentTimeMillis() + nextDumpTimeout(dumpCnt++, > futTimeout); > } > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (IGNITE-7145) Visor CMD: Fix tests for: Ignite Visor Console
Vasiliy Sisko created IGNITE-7145: - Summary: Visor CMD: Fix tests for: Ignite Visor Console Key: IGNITE-7145 URL: https://issues.apache.org/jira/browse/IGNITE-7145 Project: Ignite Issue Type: Test Reporter: Vasiliy Sisko Assignee: Vasiliy Sisko https://ci.ignite.apache.org/viewLog.html?buildId=984720=buildResultsDiv=Ignite20Tests_IgniteVisorConsoleTestDetach -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (IGNITE-6339) WAL: Avoid closed by interruption exception when user thread is interrupted
[ https://issues.apache.org/jira/browse/IGNITE-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282839#comment-16282839 ] Andrey Gura edited comment on IGNITE-6339 at 12/8/17 1:09 AM: -- Using mmap with {{DEFAULT}} WAL mode and partial fsync improves perfromance ~10-20% vs master or single writer. was (Author: agura): Using mmap with {{DEFAULT}} WAL mode and partial fsync improves perfromance ~10-20%. > WAL: Avoid closed by interruption exception when user thread is interrupted > --- > > Key: IGNITE-6339 > URL: https://issues.apache.org/jira/browse/IGNITE-6339 > Project: Ignite > Issue Type: Bug > Components: persistence >Reporter: Andrey Gura >Assignee: Andrey Gura >Priority: Blocker > Labels: important > Fix For: 2.4 > > > We should have a separate writer thread for WAL that will write completed > serialized chunks of data. This will allow us avoid closed by interruption > exception when user thread is interrupted. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-7121) visorcmd: there is no output for last command in batch mode in case of using -nq option
[ https://issues.apache.org/jira/browse/IGNITE-7121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Konstantinov reassigned IGNITE-7121: -- Assignee: Alexey Kuznetsov (was: Pavel Konstantinov) > visorcmd: there is no output for last command in batch mode in case of using > -nq option > --- > > Key: IGNITE-7121 > URL: https://issues.apache.org/jira/browse/IGNITE-7121 > Project: Ignite > Issue Type: Bug > Components: visor >Affects Versions: 2.3 >Reporter: Pavel Konstantinov >Assignee: Alexey Kuznetsov > Fix For: 2.4 > > > To reproduce try to execute visorcmd in batch mode > {code} > ignitevisorcmd.bat "-nq -b=commands.visor" > {code} > with command file > {code} > open -cpath=config/your-config.xml > config > {code} > output of 'config' command will not displayed -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-6976) Visor CMD: Add ability to put/get/remove data to caches via command line Visor.
[ https://issues.apache.org/jira/browse/IGNITE-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282941#comment-16282941 ] Vasiliy Sisko commented on IGNITE-6976: --- Implemented automatic type detection and value equal to key when it is empty. > Visor CMD: Add ability to put/get/remove data to caches via command line > Visor. > --- > > Key: IGNITE-6976 > URL: https://issues.apache.org/jira/browse/IGNITE-6976 > Project: Ignite > Issue Type: Improvement > Components: wizards >Reporter: Alexey Kuznetsov >Assignee: Vasiliy Sisko > Fix For: 2.4 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-6339) WAL: Avoid closed by interruption exception when user thread is interrupted
[ https://issues.apache.org/jira/browse/IGNITE-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282839#comment-16282839 ] Andrey Gura commented on IGNITE-6339: - Using mmap with {{DEFAULT}} WAL mode and partial fsync improves perfromance ~10-20%. > WAL: Avoid closed by interruption exception when user thread is interrupted > --- > > Key: IGNITE-6339 > URL: https://issues.apache.org/jira/browse/IGNITE-6339 > Project: Ignite > Issue Type: Bug > Components: persistence >Reporter: Andrey Gura >Assignee: Andrey Gura >Priority: Blocker > Labels: important > Fix For: 2.4 > > > We should have a separate writer thread for WAL that will write completed > serialized chunks of data. This will allow us avoid closed by interruption > exception when user thread is interrupted. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-6999) Add a flag for Visor batch mode to output only command results without additional info.
[ https://issues.apache.org/jira/browse/IGNITE-6999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Konstantinov reassigned IGNITE-6999: -- Assignee: Vasiliy Sisko (was: Pavel Konstantinov) > Add a flag for Visor batch mode to output only command results without > additional info. > --- > > Key: IGNITE-6999 > URL: https://issues.apache.org/jira/browse/IGNITE-6999 > Project: Ignite > Issue Type: New Feature > Components: visor >Affects Versions: 2.1 >Reporter: Alexandr Fedotov >Assignee: Vasiliy Sisko > Fix For: 2.4 > > > Currently, in batch mode, Visor Command Line simply run supplied commands one > by one as if they were entered from the keyboard which results in a quite > verbose output. > A new flag should be introduced like {{--silent}} to suppress additional info > output and left only output related directly to the executed commands. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (IGNITE-369) Cache manager should switch cache statisticsEnabled property globaly
[ https://issues.apache.org/jira/browse/IGNITE-369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282555#comment-16282555 ] Aleksey Plekhanov edited comment on IGNITE-369 at 12/7/17 9:25 PM: --- [~avinogradov]], Current implementation register {{javax.cache.management.CacheStatisticsMXBean}} (which are located at {{javax.cache}} -> {{CacheStatistics}} -> {{_ignite config_}} -> {{_cache name_}}) when {{enableStatistics}} method is invoked. Ignite also register {{org.apache.ignite.mxbean.CacheMetricsMXBean}} (which extends {{javax.cache.management.CacheStatisticsMXBean}}) when cache starts. was (Author: alex_pl): [~avinograd], Current implementation register {{javax.cache.management.CacheStatisticsMXBean}} (which are located at {{javax.cache}} -> {{CacheStatistics}} -> {{_ignite config_}} -> {{_cache name_}}) when {{enableStatistics}} method is invoked. Ignite also register {{org.apache.ignite.mxbean.CacheMetricsMXBean}} (which extends {{javax.cache.management.CacheStatisticsMXBean}}) when cache starts. > Cache manager should switch cache statisticsEnabled property globaly > > > Key: IGNITE-369 > URL: https://issues.apache.org/jira/browse/IGNITE-369 > Project: Ignite > Issue Type: Task >Affects Versions: sprint-2 >Reporter: Alexey Kuznetsov >Assignee: Aleksey Plekhanov > > Also you should take care about new nodes that joining grid. > New node could have statisticsEnabled with opposite value that nodes in grid. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-369) Cache manager should switch cache statisticsEnabled property globaly
[ https://issues.apache.org/jira/browse/IGNITE-369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282555#comment-16282555 ] Aleksey Plekhanov commented on IGNITE-369: -- [~avinograd], Current implementation register {{javax.cache.management.CacheStatisticsMXBean}} (which are located at {{javax.cache}} -> {{CacheStatistics}} -> {{_ignite config_}} -> {{_cache name_}}) when {{enableStatistics}} method is invoked. Ignite also register {{org.apache.ignite.mxbean.CacheMetricsMXBean}} (which extends {{javax.cache.management.CacheStatisticsMXBean}}) when cache starts. > Cache manager should switch cache statisticsEnabled property globaly > > > Key: IGNITE-369 > URL: https://issues.apache.org/jira/browse/IGNITE-369 > Project: Ignite > Issue Type: Task >Affects Versions: sprint-2 >Reporter: Alexey Kuznetsov >Assignee: Aleksey Plekhanov > > Also you should take care about new nodes that joining grid. > New node could have statisticsEnabled with opposite value that nodes in grid. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7055) Text query for a particular field not working
[ https://issues.apache.org/jira/browse/IGNITE-7055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282804#comment-16282804 ] Roman Shtykh commented on IGNITE-7055: -- [~vkulichenko] I believe it can be done, but do we really need to do it? ;) All SQL indexes are upper-cased. Shall we treat text indexes differently? > Text query for a particular field not working > - > > Key: IGNITE-7055 > URL: https://issues.apache.org/jira/browse/IGNITE-7055 > Project: Ignite > Issue Type: Bug > Components: cache >Affects Versions: 2.3 >Reporter: Valentin Kulichenko >Assignee: Roman Shtykh > > Lucene queries allow to specify a specific field name to search in [1], > however this doesn't seem to work in latest versions of Ignite. > To reproduce, modify {{CacheQueryExample#textQuery}} to use Lucene field > expression: > {code} > QueryCursor> masters = > cache.query(new TextQuery (Person.class, "resume:Master")); > {code} > This query returns empty result. > [1] > http://lucene.apache.org/core/5_5_2/queryparser/org/apache/lucene/queryparser/classic/package-summary.html#Fields -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (IGNITE-6339) WAL: Avoid closed by interruption exception when user thread is interrupted
[ https://issues.apache.org/jira/browse/IGNITE-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281803#comment-16281803 ] Andrey Gura edited comment on IGNITE-6339 at 12/8/17 12:21 AM: --- As solution the following are implemented: - Ring buffer (see {{SegmentedRingByteBuffer}}) that reserve segment (buffer slice) for thread that want write WAL records. Thread serializes WAL records to the segment and calculate CRC if enabled. As result all threads serialize record in parallel manner to the ring buffer. - Dedicated single thread that handles fsync requests and flushes data from the ring buffer to the file channel. This thread can't be interrupted via public API in distinction of current implementation. Threads that initiate fsync will be parked until data will be flushed to disk. This solution solves problem with interrupts and improve WAL write performance for most cases in {{LOG_ONLY}} WAL mode. But this change leads to performance drop for cases when local thread writes data to the local node. It is valid for cases with 1-4 threads. For larger amount of thread we have better performance. In order to improve performance for case mentioned above we tried mapped file. This solution works very well and has better performance for any amount of threads. But {{MappedByteBuffer}} don't have method for partial fsync of data and for naive fsync ({{#force}} method) has performance drop for {{DEFAULT}} WAL mode. So we have three implementations: master, single writer and mmap. See rough benchmarks results below (throughput of cache.put, ops/sec): *BACKGROUND WAL mode* | Threads | master | single writer | mmap | | 1 | 70-80 K | 64-65 K | 70-80 K | | 2 | 127-128 K | 100-110 K | 127-128 K | | 4 | 190-200 K | 170-180 K | 190-200 K | | 8 | 220-230K | 220-230 K | 220-230 K | For {{BACKGROUND}} mode throughput values are comparable for all implementations. *LOG_ONLY WAL mode* | Threads | master | single writer | mmap | | 1 | 60-65 K | 36-37 K | 70-80 K | | 2 | 100-105 K | 60-70 K | 124-125 K | | 4 | 130-140 K | 100-110 K | 190-200 K | | 8 | 50-60 K | 150-160 K | 210-220 K | For {{LOG_ONLY}} mode single writer performs better than master for larger amount of threads. But mmap is the best. *DEFAULT WAL mode* | Threads | master | single writer | mmap | | 1 | 1 K | 1 K | 1 K | | 2 | 1-2 K | 1-2 K | 1 K | | 4 | 3-4 K | 3-4 K | 1 K | | 8 | 5-6 K | 5-6 K | 1 K | For {{DEFAULT}} mode we have performance drop with mmap. But it seems that partial fsync should solve it. Any way changes related with this issue allow switch between mmap and signle writer solution using system property. *Note*: single writer and mmap still use {{fileIO.close()}} call that is interruptible. So {{ClosedByInterruption}} exception still has a chance to be thrown. This problem is still in TODO's that should be fixed. was (Author: agura): As solution the following are implemented: - Ring buffer (see {{SegmentedRingByteBuffer}}) that reserve segment (buffer slice) for thread that want write WAL records. Thread serializes WAL records to the segment and calculate CRC if enabled. As result all threads serialize record in parallel manner to the ring buffer. - Dedicated single thread that handles fsync requests and flushes data from the ring buffer to the file channel. This thread can't be interrupted via public API in distinction of current implementation. Threads that initiate fsync will be parked until data will be flushed to disk. This solution solves problem with interrupts and improve WAL write performance for most cases in {{LOG_ONLY}} WAL mode. But this change leads to performance drop for cases when local thread writes data to the local node. It is valid for cases with 1-4 threads. For larger amount of thread we have better performance. In order to improve performance for case mentioned above we tried mapped file. This solution works very well and has better performance for any amount of threads. But {{MappedByteBuffer}} don't have method for partial fsync of data and for naive fsync ({{#force}} method) has performance drop for {{DEFAULT}} WAL mode. So we have three implementations: master, single writer and mmap. See rough benchmarks results below (throughput ops/sec): *BACKGROUND WAL mode* | Threads | master | single writer | mmap | | 1 | 70-80 K | 64-65 K | 70-80 K | | 2 | 127-128 K | 100-110 K | 127-128 K | | 4 | 190-200 K | 170-180 K | 190-200 K | | 8 | 220-230K | 220-230 K | 220-230 K | For {{BACKGROUND}} mode throughput values are comparable for all implementations. *LOG_ONLY WAL mode* | Threads | master | single writer | mmap | | 1 | 60-65 K | 36-37 K | 70-80 K | | 2 | 100-105 K | 60-70 K | 124-125 K | | 4 | 130-140 K | 100-110 K | 190-200 K | | 8 | 50-60 K | 150-160 K | 210-220 K | For {{LOG_ONLY}} mode single writer performs better than master for larger amount of threads. But mmap
[jira] [Commented] (IGNITE-7055) Text query for a particular field not working
[ https://issues.apache.org/jira/browse/IGNITE-7055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282775#comment-16282775 ] Valentin Kulichenko commented on IGNITE-7055: - [~roman_s], is there a way to make them case sensitive in Ignite as well, so that we're consistent with Lucene? > Text query for a particular field not working > - > > Key: IGNITE-7055 > URL: https://issues.apache.org/jira/browse/IGNITE-7055 > Project: Ignite > Issue Type: Bug > Components: cache >Affects Versions: 2.3 >Reporter: Valentin Kulichenko >Assignee: Roman Shtykh > > Lucene queries allow to specify a specific field name to search in [1], > however this doesn't seem to work in latest versions of Ignite. > To reproduce, modify {{CacheQueryExample#textQuery}} to use Lucene field > expression: > {code} > QueryCursor> masters = > cache.query(new TextQuery (Person.class, "resume:Master")); > {code} > This query returns empty result. > [1] > http://lucene.apache.org/core/5_5_2/queryparser/org/apache/lucene/queryparser/classic/package-summary.html#Fields -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (IGNITE-7143) CPP: Can not insert zero decimal value with the ODBC driver.
[ https://issues.apache.org/jira/browse/IGNITE-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy Setrakyan updated IGNITE-7143: -- Priority: Blocker (was: Major) > CPP: Can not insert zero decimal value with the ODBC driver. > > > Key: IGNITE-7143 > URL: https://issues.apache.org/jira/browse/IGNITE-7143 > Project: Ignite > Issue Type: Bug > Components: odbc >Affects Versions: 2.1 >Reporter: Igor Sapego >Assignee: Igor Sapego >Priority: Blocker > Fix For: 2.4 > > > Create the following table: > {code} > CREATE TABLE IF NOT EXISTS TestTable (RecId varchar PRIMARY KEY, RecValue > DECIMAL(4,2)) > WITH "template=replicated, cache_name=TestTable_Cache"; > {code} > Then do an ODBC insert using the OdbcParameter with the OdbcCommand object: > {code} > INSERT INTO TestTable (RecId, RecValue) VALUES ('1', ?) > {code} > The Odbc error is "The connection has been disabled." however the JVM is > throwing this error: > {noformat} > [SEVERE][client-connector-#47][ClientListenerNioListener] Failed to parse > client request. > java.lang.ArrayIndexOutOfBoundsException: 0 > at org.apache.ignite.internal.binary.BinaryUtils.doReadDecimal > {noformat} > Everything works out ok until the actual value set on the parameter is 0. > Null works fine, values other than 0 work fine. Precision and > Scale are set appropriately. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (IGNITE-7143) CPP: Can not insert zero decimal value with the ODBC driver.
[ https://issues.apache.org/jira/browse/IGNITE-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy Setrakyan updated IGNITE-7143: -- Fix Version/s: 2.4 > CPP: Can not insert zero decimal value with the ODBC driver. > > > Key: IGNITE-7143 > URL: https://issues.apache.org/jira/browse/IGNITE-7143 > Project: Ignite > Issue Type: Bug > Components: odbc >Affects Versions: 2.1 >Reporter: Igor Sapego >Assignee: Igor Sapego > Fix For: 2.4 > > > Create the following table: > {code} > CREATE TABLE IF NOT EXISTS TestTable (RecId varchar PRIMARY KEY, RecValue > DECIMAL(4,2)) > WITH "template=replicated, cache_name=TestTable_Cache"; > {code} > Then do an ODBC insert using the OdbcParameter with the OdbcCommand object: > {code} > INSERT INTO TestTable (RecId, RecValue) VALUES ('1', ?) > {code} > The Odbc error is "The connection has been disabled." however the JVM is > throwing this error: > {noformat} > [SEVERE][client-connector-#47][ClientListenerNioListener] Failed to parse > client request. > java.lang.ArrayIndexOutOfBoundsException: 0 > at org.apache.ignite.internal.binary.BinaryUtils.doReadDecimal > {noformat} > Everything works out ok until the actual value set on the parameter is 0. > Null works fine, values other than 0 work fine. Precision and > Scale are set appropriately. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-7143) CPP: Can not insert zero decimal value with the ODBC driver.
[ https://issues.apache.org/jira/browse/IGNITE-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy Setrakyan reassigned IGNITE-7143: - Assignee: Igor Sapego > CPP: Can not insert zero decimal value with the ODBC driver. > > > Key: IGNITE-7143 > URL: https://issues.apache.org/jira/browse/IGNITE-7143 > Project: Ignite > Issue Type: Bug > Components: odbc >Affects Versions: 2.1 >Reporter: Igor Sapego >Assignee: Igor Sapego > Fix For: 2.4 > > > Create the following table: > {code} > CREATE TABLE IF NOT EXISTS TestTable (RecId varchar PRIMARY KEY, RecValue > DECIMAL(4,2)) > WITH "template=replicated, cache_name=TestTable_Cache"; > {code} > Then do an ODBC insert using the OdbcParameter with the OdbcCommand object: > {code} > INSERT INTO TestTable (RecId, RecValue) VALUES ('1', ?) > {code} > The Odbc error is "The connection has been disabled." however the JVM is > throwing this error: > {noformat} > [SEVERE][client-connector-#47][ClientListenerNioListener] Failed to parse > client request. > java.lang.ArrayIndexOutOfBoundsException: 0 > at org.apache.ignite.internal.binary.BinaryUtils.doReadDecimal > {noformat} > Everything works out ok until the actual value set on the parameter is 0. > Null works fine, values other than 0 work fine. Precision and > Scale are set appropriately. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (IGNITE-369) Cache manager should switch cache statisticsEnabled property globaly
[ https://issues.apache.org/jira/browse/IGNITE-369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282555#comment-16282555 ] Aleksey Plekhanov edited comment on IGNITE-369 at 12/7/17 9:25 PM: --- [~avinogradov], Current implementation register {{javax.cache.management.CacheStatisticsMXBean}} (which are located at {{javax.cache}} -> {{CacheStatistics}} -> {{_ignite config_}} -> {{_cache name_}}) when {{enableStatistics}} method is invoked. Ignite also register {{org.apache.ignite.mxbean.CacheMetricsMXBean}} (which extends {{javax.cache.management.CacheStatisticsMXBean}}) when cache starts. was (Author: alex_pl): [~avinogradov]], Current implementation register {{javax.cache.management.CacheStatisticsMXBean}} (which are located at {{javax.cache}} -> {{CacheStatistics}} -> {{_ignite config_}} -> {{_cache name_}}) when {{enableStatistics}} method is invoked. Ignite also register {{org.apache.ignite.mxbean.CacheMetricsMXBean}} (which extends {{javax.cache.management.CacheStatisticsMXBean}}) when cache starts. > Cache manager should switch cache statisticsEnabled property globaly > > > Key: IGNITE-369 > URL: https://issues.apache.org/jira/browse/IGNITE-369 > Project: Ignite > Issue Type: Task >Affects Versions: sprint-2 >Reporter: Alexey Kuznetsov >Assignee: Aleksey Plekhanov > > Also you should take care about new nodes that joining grid. > New node could have statisticsEnabled with opposite value that nodes in grid. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-6867) Implement new JMX metrics for topology monitoring
[ https://issues.apache.org/jira/browse/IGNITE-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282328#comment-16282328 ] Max Shonichev commented on IGNITE-6867: --- How come this merged to 2.4.1-p2? > Implement new JMX metrics for topology monitoring > - > > Key: IGNITE-6867 > URL: https://issues.apache.org/jira/browse/IGNITE-6867 > Project: Ignite > Issue Type: New Feature >Reporter: Aleksey Plekhanov >Assignee: Aleksey Plekhanov > Labels: iep-6, jmx > Fix For: 2.4 > > > These additional metrics and methods should be implemented: > * Current topology version > * Total server nodes count > * Total client nodes count > * Method to count nodes filtered by some node attribute > * Method to count nodes grouped by some node attribute > > There is already a ticket to implement first 2 metrics from this list > (IGNITE-6844) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-6373) Create example for local and distributed k-means algorithm
[ https://issues.apache.org/jira/browse/IGNITE-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282213#comment-16282213 ] ASF GitHub Bot commented on IGNITE-6373: Github user asfgit closed the pull request at: https://github.com/apache/ignite/pull/3173 > Create example for local and distributed k-means algorithm > -- > > Key: IGNITE-6373 > URL: https://issues.apache.org/jira/browse/IGNITE-6373 > Project: Ignite > Issue Type: Improvement > Components: ml >Reporter: Yury Babak >Assignee: Oleg Ignatenko > Labels: examples > Fix For: 2.4 > > > Currently we no examples for both versions of k-means. So we need at least > two example for local k-means and for distributed k-means. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-369) Cache manager should switch cache statisticsEnabled property globaly
[ https://issues.apache.org/jira/browse/IGNITE-369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282194#comment-16282194 ] Anton Vinogradov commented on IGNITE-369: - [~alex_pl] , I see no reason to have local method. Seems, we should replace current implementation with global. Please provide additional info about mxbean will be registered in that case. > Cache manager should switch cache statisticsEnabled property globaly > > > Key: IGNITE-369 > URL: https://issues.apache.org/jira/browse/IGNITE-369 > Project: Ignite > Issue Type: Task >Affects Versions: sprint-2 >Reporter: Alexey Kuznetsov >Assignee: Aleksey Plekhanov > > Also you should take care about new nodes that joining grid. > New node could have statisticsEnabled with opposite value that nodes in grid. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7113) "Key is missing from query" when creating table with key_type=java.lang.String
[ https://issues.apache.org/jira/browse/IGNITE-7113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282182#comment-16282182 ] ASF GitHub Bot commented on IGNITE-7113: GitHub user alexpaschenko opened a pull request: https://github.com/apache/ignite/pull/3176 IGNITE-7113 Processing of redundant type names You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-7113 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/ignite/pull/3176.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3176 commit 071d55881db33cadcda40b568978bca3a151d8b3 Author: Alexander PaschenkoDate: 2017-12-07T17:11:11Z IGNITE-7113 Processing of redundant type names > "Key is missing from query" when creating table with key_type=java.lang.String > -- > > Key: IGNITE-7113 > URL: https://issues.apache.org/jira/browse/IGNITE-7113 > Project: Ignite > Issue Type: Bug > Components: sql >Affects Versions: 2.3 >Reporter: Ilya Kasnacheev >Assignee: Alexander Paschenko > Attachments: IgniteStringKeyTest.java > > > When creating a table of > {code} > CREATE TABLE IF NOT EXISTS TableWithStringKey ( > ID VARCHAR PRIMARY KEY, > DataNodeId VARCHAR > ) WITH "backups=1, cache_name=TableWithStringKey, atomicity=transactional, > key_type=java.lang.String, value_type=TableWithStringKey" > {code} > and attempting an insert later > {code} > INSERT INTO TableWithStringKey (ID, DataNodeId) VALUES ('ref2', 'src2') > {code} > There's suddently an exception > {code} > javax.cache.CacheException: class > org.apache.ignite.internal.processors.query.IgniteSQLException: Failed to > execute DML statement [stmt=INSERT INTO TableWithStringKey (ID, DataNodeId) > VALUES ('ref2', 'src2'), params=null] > at > org.apache.ignite.internal.processors.cache.IgniteCacheProxyImpl.query(IgniteCacheProxyImpl.java:597) > at > org.apache.ignite.internal.processors.cache.IgniteCacheProxyImpl.query(IgniteCacheProxyImpl.java:560) > at > org.apache.ignite.internal.processors.cache.GatewayProtectedCacheProxy.query(GatewayProtectedCacheProxy.java:382) > at > com.gridgain.reproducer.IgniteStringKeyTest.insertTest(IgniteStringKeyTest.java:34) > ... 24 more > Caused by: class > org.apache.ignite.internal.processors.query.IgniteSQLException: Failed to > execute DML statement [stmt=INSERT INTO TableWithStringKey (ID, DataNodeId) > VALUES ('ref2', 'src2'), params=null] > at > org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing.queryDistributedSqlFields(IgniteH2Indexing.java:1459) > at > org.apache.ignite.internal.processors.query.GridQueryProcessor$5.applyx(GridQueryProcessor.java:1909) > at > org.apache.ignite.internal.processors.query.GridQueryProcessor$5.applyx(GridQueryProcessor.java:1907) > at > org.apache.ignite.internal.util.lang.IgniteOutClosureX.apply(IgniteOutClosureX.java:36) > at > org.apache.ignite.internal.processors.query.GridQueryProcessor.executeQuery(GridQueryProcessor.java:2445) > at > org.apache.ignite.internal.processors.query.GridQueryProcessor.querySqlFields(GridQueryProcessor.java:1914) > at > org.apache.ignite.internal.processors.cache.IgniteCacheProxyImpl.query(IgniteCacheProxyImpl.java:585) > ... 27 more > Caused by: class org.apache.ignite.IgniteCheckedException: Key is missing > from query > at > org.apache.ignite.internal.processors.query.h2.dml.UpdatePlanBuilder.createSupplier(UpdatePlanBuilder.java:369) > at > org.apache.ignite.internal.processors.query.h2.dml.UpdatePlanBuilder.planForInsert(UpdatePlanBuilder.java:211) > at > org.apache.ignite.internal.processors.query.h2.dml.UpdatePlanBuilder.planForStatement(UpdatePlanBuilder.java:98) > at > org.apache.ignite.internal.processors.query.h2.DmlStatementsProcessor.getPlanForStatement(DmlStatementsProcessor.java:473) > at > org.apache.ignite.internal.processors.query.h2.DmlStatementsProcessor.updateSqlFields(DmlStatementsProcessor.java:170) > at > org.apache.ignite.internal.processors.query.h2.DmlStatementsProcessor.updateSqlFieldsDistributed(DmlStatementsProcessor.java:229) > at > org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing.queryDistributedSqlFields(IgniteH2Indexing.java:1453) > ... 33 more > {code} > that goes away if you remove "key_type=java.lang.String" > I'm attaching a reproducer class. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7110) Javadoc package descriptions missed for ML
[ https://issues.apache.org/jira/browse/IGNITE-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282126#comment-16282126 ] ASF GitHub Bot commented on IGNITE-7110: Github user asfgit closed the pull request at: https://github.com/apache/ignite/pull/3174 > Javadoc package descriptions missed for ML > -- > > Key: IGNITE-7110 > URL: https://issues.apache.org/jira/browse/IGNITE-7110 > Project: Ignite > Issue Type: Bug > Components: ml >Affects Versions: 2.3 >Reporter: Sergey Kozlov >Assignee: Yury Babak >Priority: Minor > Fix For: 2.4 > > > The following packages have no description: > org.apache.ignite.development.utils > org.apache.ignite.ml.trees.trainers.columnbased.caches > org.apache.ignite.ml.util -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7110) Javadoc package descriptions missed for ML
[ https://issues.apache.org/jira/browse/IGNITE-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282106#comment-16282106 ] ASF GitHub Bot commented on IGNITE-7110: GitHub user ybabak opened a pull request: https://github.com/apache/ignite/pull/3174 IGNITE-7110: Javadoc package descriptions missed for ML fixed. You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-7110 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/ignite/pull/3174.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3174 commit 3e48a703208b99451f0191746cc20f9ec7809d13 Author: YuriBabakDate: 2017-12-07T16:27:39Z IGNITE-7110: Javadoc package descriptions missed for ML fixed. > Javadoc package descriptions missed for ML > -- > > Key: IGNITE-7110 > URL: https://issues.apache.org/jira/browse/IGNITE-7110 > Project: Ignite > Issue Type: Bug > Components: ml >Affects Versions: 2.3 >Reporter: Sergey Kozlov >Assignee: Yury Babak >Priority: Minor > Fix For: 2.4 > > > The following packages have no description: > org.apache.ignite.development.utils > org.apache.ignite.ml.trees.trainers.columnbased.caches > org.apache.ignite.ml.util -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7008) TcpDiscoverySharedFsIpFinder fails with NPE if address can't be resolved.
[ https://issues.apache.org/jira/browse/IGNITE-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282088#comment-16282088 ] ASF GitHub Bot commented on IGNITE-7008: Github user asfgit closed the pull request at: https://github.com/apache/ignite/pull/3087 > TcpDiscoverySharedFsIpFinder fails with NPE if address can't be resolved. > - > > Key: IGNITE-7008 > URL: https://issues.apache.org/jira/browse/IGNITE-7008 > Project: Ignite > Issue Type: Bug > Components: general >Reporter: Andrew Mashenkov >Assignee: Andrew Mashenkov > > Seems, we should add a check to registerAddresses() method if address has > been resolved and use hostname otherwise. > 2017-11-23 14:25:19,487 ERROR [tcp-disco-msg-worker-#2%null%] > [Slf4jLogger.java:119] Runtime error caught during grid runnable execution: > IgniteSpiThread [name=tcp-disco-msg-worker-#2%null%] > {noformat} > java.lang.NullPointerException: null > at > org.apache.ignite.spi.discovery.tcp.ipfinder.sharedfs.TcpDiscoverySharedFsIpFinder.name(TcpDiscoverySharedFsIpFinder.java:277) > at > org.apache.ignite.spi.discovery.tcp.ipfinder.sharedfs.TcpDiscoverySharedFsIpFinder.distinctNames(TcpDiscoverySharedFsIpFinder.java:260) > at > org.apache.ignite.spi.discovery.tcp.ipfinder.sharedfs.TcpDiscoverySharedFsIpFinder.registerAddresses(TcpDiscoverySharedFsIpFinder.java:220) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processNodeAddFinishedMessage(ServerImpl.java:4442) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processNodeAddedMessage(ServerImpl.java:4052) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processMessage(ServerImpl.java:2623) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processMessage(ServerImpl.java:2437) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerAdapter.body(ServerImpl.java:6568) > at > org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(ServerImpl.java:2523) > at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62) > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-7110) Javadoc package descriptions missed for ML
[ https://issues.apache.org/jira/browse/IGNITE-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yury Babak reassigned IGNITE-7110: -- Assignee: Yury Babak > Javadoc package descriptions missed for ML > -- > > Key: IGNITE-7110 > URL: https://issues.apache.org/jira/browse/IGNITE-7110 > Project: Ignite > Issue Type: Bug > Components: ml >Affects Versions: 2.3 >Reporter: Sergey Kozlov >Assignee: Yury Babak >Priority: Minor > Fix For: 2.4 > > > The following packages have no description: > org.apache.ignite.development.utils > org.apache.ignite.ml.trees.trainers.columnbased.caches > org.apache.ignite.ml.util -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-369) Cache manager should switch cache statisticsEnabled property globaly
[ https://issues.apache.org/jira/browse/IGNITE-369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282082#comment-16282082 ] Aleksey Plekhanov commented on IGNITE-369: -- Where in the public API is the best place for a methods to enable/disable statistics? At the moment, there is a method {{org.apache.ignite.cache.CacheManager#enableStatistics}}, that enables/disables statistics locally, but it also register or unregister new MXBean (for JSR-107 compatibility, as I understand it). I can change this method to enable/disable statistics globally, but for each cache additional MXBeans will be registered when this method will be used to enable statistics. Also I can implement a new method in {{CacheManager}} (something like {{enableStatisticsGlobally}}), but, perhaps, API will become inconsistent (public methods which are not declared in {{javax.cache.CacheManager}}). Another proposal was to implement new methods in {{IgniteCluster}}, but for now it contains mostly methods for topology management. Which way to choose? Are there any other proposals? > Cache manager should switch cache statisticsEnabled property globaly > > > Key: IGNITE-369 > URL: https://issues.apache.org/jira/browse/IGNITE-369 > Project: Ignite > Issue Type: Task >Affects Versions: sprint-2 >Reporter: Alexey Kuznetsov >Assignee: Aleksey Plekhanov > > Also you should take care about new nodes that joining grid. > New node could have statisticsEnabled with opposite value that nodes in grid. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (IGNITE-6373) Create example for local and distributed k-means algorithm
[ https://issues.apache.org/jira/browse/IGNITE-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271170#comment-16271170 ] Oleg Ignatenko edited comment on IGNITE-6373 at 12/7/17 4:11 PM: - Drafted examples in branch _ignite-6373_. Plan to wait for a bit for maybe some changes made to examples in the course of IGNITE-6872 will merge to master and if this happens soon enough will accommodate. *Update* accommodated final implementation is in branch [ignite-6373-1|https://github.com/gridgain/apache-ignite/tree/ignite-6373-1] was (Author: oignatenko): drafted examples in branch [ignite-6373|https://github.com/gridgain/apache-ignite/tree/ignite-6373]. Plan to wait for a bit for maybe some changes made to examples in the course of IGNITE-6872 will merge to master and if this happens soon enough will accommodate > Create example for local and distributed k-means algorithm > -- > > Key: IGNITE-6373 > URL: https://issues.apache.org/jira/browse/IGNITE-6373 > Project: Ignite > Issue Type: Improvement > Components: ml >Reporter: Yury Babak >Assignee: Oleg Ignatenko > Labels: examples > > Currently we no examples for both versions of k-means. So we need at least > two example for local k-means and for distributed k-means. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-6373) Create example for local and distributed k-means algorithm
[ https://issues.apache.org/jira/browse/IGNITE-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282048#comment-16282048 ] ASF GitHub Bot commented on IGNITE-6373: GitHub user oignatenko opened a pull request: https://github.com/apache/ignite/pull/3173 IGNITE-6373 Create example for local and distributed k-means algorithm - examples implemented -- verified with diffs overview, clean build and execution of examples You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-6373-1 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/ignite/pull/3173.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3173 commit b0cc9d74dfd664f3be11cadb0a43369819b3e8b5 Author: Oleg IgnatenkoDate: 2017-12-07T15:56:14Z IGNITE-6373 Create example for local and distributed k-means algorithm - examples implemented -- verified with diffs overview, clean build and execution of examples > Create example for local and distributed k-means algorithm > -- > > Key: IGNITE-6373 > URL: https://issues.apache.org/jira/browse/IGNITE-6373 > Project: Ignite > Issue Type: Improvement > Components: ml >Reporter: Yury Babak >Assignee: Oleg Ignatenko > Labels: examples > > Currently we no examples for both versions of k-means. So we need at least > two example for local k-means and for distributed k-means. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7109) .NET: Thin client: Async cache operations
[ https://issues.apache.org/jira/browse/IGNITE-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282009#comment-16282009 ] Pavel Tupitsyn commented on IGNITE-7109: Hybrid approach implemented: # Send requests in blocking mode ({{Socket.Send}}) # Use a dedicated thread to read responses in blocking mode ({{Socket.Receive}}) and complete async operations with {{TaskCompletionSource}} # Synchronous calls ({{cache.Put}}): If there are no pending socket operations - read response in blocking mode right from current thread. Otherwise fall back to async mechanism with background thread. > .NET: Thin client: Async cache operations > - > > Key: IGNITE-7109 > URL: https://issues.apache.org/jira/browse/IGNITE-7109 > Project: Ignite > Issue Type: Improvement > Components: platforms, thin client >Reporter: Pavel Tupitsyn >Assignee: Pavel Tupitsyn > Labels: .NET > Fix For: 2.4 > > > Add async operations to {{ICacheClient}}. > Thin client suppots asynchrony with requestId mechanism. Make sure it works > with .NET. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7144) Java 9: fix build issue with tools.jar not found
[ https://issues.apache.org/jira/browse/IGNITE-7144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281983#comment-16281983 ] ASF GitHub Bot commented on IGNITE-7144: GitHub user vveider opened a pull request: https://github.com/apache/ignite/pull/3172 IGNITE-7144 Java 9: fix build issue with tools.jar not found * added profiles to parent and ignite-tools modules to detect java-9 environment and run parametrised build * added macOS compatibility for previouse java versions You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-7144 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/ignite/pull/3172.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3172 commit fedf126db357ba04cda08cdec2c709101140ff4c Author: Ivanov PetrDate: 2017-12-07T15:07:59Z IGNITE-7144 Java 9: fix build issue with tools.jar not found * added profiles to parent and ignite-tools modules to detect java-9 environment and run parametrised build * added macOS compatibility for previouse java versions > Java 9: fix build issue with tools.jar not found > > > Key: IGNITE-7144 > URL: https://issues.apache.org/jira/browse/IGNITE-7144 > Project: Ignite > Issue Type: Bug >Reporter: Peter Ivanov >Assignee: Peter Ivanov > > {code} > [ERROR] Failed to execute goal on project ignite-tools: Could not resolve > dependencies for project org.apache.ignite:ignite-tools:jar:2.4.0-SNAPSHOT: > Could not find artifact com.sun:tools:jar:9.0.1 at specified path > /Library/Java/JavaVirtualMachines/jdk-9.0.1.jdk/Contents/Home/../lib/tools.jar > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-5874) Store TTL expire times in B+ tree on per-partition basis
[ https://issues.apache.org/jira/browse/IGNITE-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Mashenkov reassigned IGNITE-5874: Assignee: Andrew Mashenkov > Store TTL expire times in B+ tree on per-partition basis > > > Key: IGNITE-5874 > URL: https://issues.apache.org/jira/browse/IGNITE-5874 > Project: Ignite > Issue Type: Improvement > Components: cache, persistence >Affects Versions: 2.1 >Reporter: Ivan Rakov >Assignee: Andrew Mashenkov > Attachments: IgnitePdsWithTtlTest.java > > > TTL expire times for entries are stored in PendingEntriesTree, which is > singleton for cache. When expiration occurs, all system threads iterate > through the tree in order to remove expired entries. Iterating through single > tree causes contention and perfomance loss. > Related performance issue: https://issues.apache.org/jira/browse/IGNITE-5793 > We should keep instance of PendingEntriesTree for each partition, like we do > for CacheDataTree. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (IGNITE-7144) Java 9: fix build issue with tools.jar not found
[ https://issues.apache.org/jira/browse/IGNITE-7144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Ivanov updated IGNITE-7144: - Issue Type: Bug (was: Improvement) > Java 9: fix build issue with tools.jar not found > > > Key: IGNITE-7144 > URL: https://issues.apache.org/jira/browse/IGNITE-7144 > Project: Ignite > Issue Type: Bug >Reporter: Peter Ivanov >Assignee: Peter Ivanov > > {code} > [ERROR] Failed to execute goal on project ignite-tools: Could not resolve > dependencies for project org.apache.ignite:ignite-tools:jar:2.4.0-SNAPSHOT: > Could not find artifact com.sun:tools:jar:9.0.1 at specified path > /Library/Java/JavaVirtualMachines/jdk-9.0.1.jdk/Contents/Home/../lib/tools.jar > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (IGNITE-7114) CPP: C++ node can't start without java examples folder
[ https://issues.apache.org/jira/browse/IGNITE-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281974#comment-16281974 ] Pavel Tupitsyn edited comment on IGNITE-7114 at 12/7/17 3:04 PM: - [~isapego] logic looks good to me, but there is a lot of code duplication. I think Windows and Linux differ only in path separators and jvm library names, so all the logic can be shared. was (Author: ptupitsyn): [~isapego] logic looks good to me, but there is a lot of code duplication. I thin Windows and Linux logic differs only in path separators and jvm library names, so all the logic can be shared. > CPP: C++ node can't start without java examples folder > -- > > Key: IGNITE-7114 > URL: https://issues.apache.org/jira/browse/IGNITE-7114 > Project: Ignite > Issue Type: Bug > Components: platforms >Affects Versions: 2.1 >Reporter: Evgenii Zhuravlev >Assignee: Igor Sapego >Priority: Critical > Fix For: 2.4 > > Attachments: sample.png > > > Error message: > ERROR: Java classpath is empty (did you set {{IGNITE_HOME}} environment > variable?) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7114) CPP: C++ node can't start without java examples folder
[ https://issues.apache.org/jira/browse/IGNITE-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281974#comment-16281974 ] Pavel Tupitsyn commented on IGNITE-7114: [~isapego] logic looks good to me, but there is a lot of code duplication. I thin Windows and Linux logic differs only in path separators and jvm library names, so all the logic can be shared. > CPP: C++ node can't start without java examples folder > -- > > Key: IGNITE-7114 > URL: https://issues.apache.org/jira/browse/IGNITE-7114 > Project: Ignite > Issue Type: Bug > Components: platforms >Affects Versions: 2.1 >Reporter: Evgenii Zhuravlev >Assignee: Igor Sapego >Priority: Critical > Fix For: 2.4 > > Attachments: sample.png > > > Error message: > ERROR: Java classpath is empty (did you set {{IGNITE_HOME}} environment > variable?) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (IGNITE-7143) CPP: Can not insert zero decimal value with the ODBC driver.
Igor Sapego created IGNITE-7143: --- Summary: CPP: Can not insert zero decimal value with the ODBC driver. Key: IGNITE-7143 URL: https://issues.apache.org/jira/browse/IGNITE-7143 Project: Ignite Issue Type: Bug Components: odbc Affects Versions: 2.1 Reporter: Igor Sapego Create the following table: {code} CREATE TABLE IF NOT EXISTS TestTable (RecId varchar PRIMARY KEY, RecValue DECIMAL(4,2)) WITH "template=replicated, cache_name=TestTable_Cache"; {code} Then do an ODBC insert using the OdbcParameter with the OdbcCommand object: {code} INSERT INTO TestTable (RecId, RecValue) VALUES ('1', ?) {code} The Odbc error is "The connection has been disabled." however the JVM is throwing this error: {noformat} [SEVERE][client-connector-#47][ClientListenerNioListener] Failed to parse client request. java.lang.ArrayIndexOutOfBoundsException: 0 at org.apache.ignite.internal.binary.BinaryUtils.doReadDecimal {noformat} Everything works out ok until the actual value set on the parameter is 0. Null works fine, values other than 0 work fine. Precision and Scale are set appropriately. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (IGNITE-7142) Introduce ability to run Ignite Tests on TeamCity with Java 9
[ https://issues.apache.org/jira/browse/IGNITE-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Ivanov resolved IGNITE-7142. -- Resolution: Done Ability added to build plan [Ignite Tests / -> Run All|https://ci.ignite.apache.org/viewType.html?buildTypeId=IgniteTests_RunAll] via parametrised run: *Run Custom Build (...)* --> *Parameters* --> *Choose JAVA* One can select from _java-1.7_, _java-1.8_ and _java-9_ environments to initiate build of all dependency builds with chosen java version. (!) NOTE: java-9 run is currently fails because of code unreadiness for compilation with java-9, which is going to be fixed in IGNITE-6728 tickets. > Introduce ability to run Ignite Tests on TeamCity with Java 9 > - > > Key: IGNITE-7142 > URL: https://issues.apache.org/jira/browse/IGNITE-7142 > Project: Ignite > Issue Type: New Feature >Reporter: Peter Ivanov >Assignee: Peter Ivanov > > Introduce ability to run Ignite Tests on TeamCity with Java 9 (and Java 1.8 > as well). -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7114) CPP: C++ node can't start without java examples folder
[ https://issues.apache.org/jira/browse/IGNITE-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281940#comment-16281940 ] Igor Sapego commented on IGNITE-7114: - [~ptupitsyn], can you take a look on a new version? > CPP: C++ node can't start without java examples folder > -- > > Key: IGNITE-7114 > URL: https://issues.apache.org/jira/browse/IGNITE-7114 > Project: Ignite > Issue Type: Bug > Components: platforms >Affects Versions: 2.1 >Reporter: Evgenii Zhuravlev >Assignee: Igor Sapego >Priority: Critical > Fix For: 2.4 > > Attachments: sample.png > > > Error message: > ERROR: Java classpath is empty (did you set {{IGNITE_HOME}} environment > variable?) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (IGNITE-7142) Introduce ability to run Ignite Tests on TeamCity with Java 9
Peter Ivanov created IGNITE-7142: Summary: Introduce ability to run Ignite Tests on TeamCity with Java 9 Key: IGNITE-7142 URL: https://issues.apache.org/jira/browse/IGNITE-7142 Project: Ignite Issue Type: New Feature Reporter: Peter Ivanov Assignee: Peter Ivanov Introduce ability to run Ignite Tests on TeamCity with Java 9 (and Java 1.8 as well). -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (IGNITE-7114) CPP: C++ node can't start without java examples folder
[ https://issues.apache.org/jira/browse/IGNITE-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281894#comment-16281894 ] Igor Sapego edited comment on IGNITE-7114 at 12/7/17 2:13 PM: -- [~apopov], I've seen the attached file. So should it be detected or should not? By the way, these checks only used when user did not provide us {{IGNITE_HOME}} and we are trying to find it by ourselves. If user provides us {{IGNITE_HOME}} that points to any existent directory, no additional checks performed now, so user can rename libs however they want, if only they point out {{IGNITE_HOME}} for us. was (Author: isapego): [~apopov], I've seen the attached file. So should it be detected or should not? By the way, these checks only used when user did not provide us {{IGNITE_HOME}} and we are trying to find it by ourselves. If user provides us {{IGNITE_HOME}} that points to any existent directory, no additional checks performed now, so user can rename libs however they want now, if only he point out {{IGNITE_HOME}} for us. > CPP: C++ node can't start without java examples folder > -- > > Key: IGNITE-7114 > URL: https://issues.apache.org/jira/browse/IGNITE-7114 > Project: Ignite > Issue Type: Bug > Components: platforms >Affects Versions: 2.1 >Reporter: Evgenii Zhuravlev >Assignee: Igor Sapego >Priority: Critical > Fix For: 2.4 > > Attachments: sample.png > > > Error message: > ERROR: Java classpath is empty (did you set {{IGNITE_HOME}} environment > variable?) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7114) CPP: C++ node can't start without java examples folder
[ https://issues.apache.org/jira/browse/IGNITE-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281894#comment-16281894 ] Igor Sapego commented on IGNITE-7114: - [~apopov], I've seen the attached file. So should it be detected or should not? By the way, these checks only used when user did not provide us {{IGNITE_HOME}} and we are trying to find it by ourselves. If user provides us {{IGNITE_HOME}} that points to any existent directory, no additional checks performed now, so user can rename libs however they want now, if only he point out {{IGNITE_HOME}} for us. > CPP: C++ node can't start without java examples folder > -- > > Key: IGNITE-7114 > URL: https://issues.apache.org/jira/browse/IGNITE-7114 > Project: Ignite > Issue Type: Bug > Components: platforms >Affects Versions: 2.1 >Reporter: Evgenii Zhuravlev >Assignee: Igor Sapego >Priority: Critical > Fix For: 2.4 > > Attachments: sample.png > > > Error message: > ERROR: Java classpath is empty (did you set {{IGNITE_HOME}} environment > variable?) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-7132) Investigate and document Ignite Persistence usage in Docker
[ https://issues.apache.org/jira/browse/IGNITE-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Magda reassigned IGNITE-7132: --- Assignee: Nikolay Tikhonov > Investigate and document Ignite Persistence usage in Docker > --- > > Key: IGNITE-7132 > URL: https://issues.apache.org/jira/browse/IGNITE-7132 > Project: Ignite > Issue Type: Task > Components: documentation >Reporter: Denis Magda >Assignee: Nikolay Tikhonov > Fix For: 2.4 > > > Inspired by the following talk: > http://apache-ignite-users.70518.x6.nabble.com/Ignite-in-docker-Native-Persistence-td18426.html > The aim is to investigate how is better to deploy Ignite persistence in > Docker. Probably with the usage of Docker volumes: > https://docs.docker.com/engine/admin/volumes/volumes/#use-a-read-only-volume > Once the configuration option is clear the following documentation needs to > be updated: > https://apacheignite.readme.io/docs/docker-deployment -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7114) CPP: C++ node can't start without java examples folder
[ https://issues.apache.org/jira/browse/IGNITE-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281874#comment-16281874 ] Alexey Popov commented on IGNITE-7114: -- [~isapego], please see the attached .png. It has {{/libs/ignite-core.jar}} file. {{/libs/ignite-core*.jar}} is ok > CPP: C++ node can't start without java examples folder > -- > > Key: IGNITE-7114 > URL: https://issues.apache.org/jira/browse/IGNITE-7114 > Project: Ignite > Issue Type: Bug > Components: platforms >Affects Versions: 2.1 >Reporter: Evgenii Zhuravlev >Assignee: Igor Sapego >Priority: Critical > Fix For: 2.4 > > Attachments: sample.png > > > Error message: > ERROR: Java classpath is empty (did you set {{IGNITE_HOME}} environment > variable?) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (IGNITE-7141) JDBC Driver 2.3.0 Incorrectly reads PK column meta data
Josh created IGNITE-7141: Summary: JDBC Driver 2.3.0 Incorrectly reads PK column meta data Key: IGNITE-7141 URL: https://issues.apache.org/jira/browse/IGNITE-7141 Project: Ignite Issue Type: Bug Components: jdbc Affects Versions: 2.3 Reporter: Josh It appears the meta data coming back while trying to read PK information about a table through the jdbc driver has two properties flipped (PK_NAME and COLUMN_NAME). I have a table with a PK column named ID and while querying the meta data through the driver I receive the following entries: PK_NAME=ID COLUMN_NAME=_KEY I verified the same shows through a jdbc tool like Squirrel sql. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (IGNITE-7114) CPP: C++ node can't start without java examples folder
[ https://issues.apache.org/jira/browse/IGNITE-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281863#comment-16281863 ] Igor Sapego edited comment on IGNITE-7114 at 12/7/17 1:50 PM: -- [~apopov], what do you mean by "check the absence of "-x.y.z" part with some error indication"? Currently, I simply check for existence of the {{/libs/ignite-core*.jar}} file. Is it OK for your case? was (Author: isapego): [~apopov], what do you mean by "check the absence of "-x.y.z" part with some error indication"? Currently, I simply check for existence of the {{/libs/ignite-core*.jar}} file. Is it Ok for your case? > CPP: C++ node can't start without java examples folder > -- > > Key: IGNITE-7114 > URL: https://issues.apache.org/jira/browse/IGNITE-7114 > Project: Ignite > Issue Type: Bug > Components: platforms >Affects Versions: 2.1 >Reporter: Evgenii Zhuravlev >Assignee: Igor Sapego >Priority: Critical > Fix For: 2.4 > > Attachments: sample.png > > > Error message: > ERROR: Java classpath is empty (did you set {{IGNITE_HOME}} environment > variable?) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7114) CPP: C++ node can't start without java examples folder
[ https://issues.apache.org/jira/browse/IGNITE-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281863#comment-16281863 ] Igor Sapego commented on IGNITE-7114: - [~apopov], what do you mean by "check the absence of "-x.y.z" part with some error indication"? Currently, I simply check for existence of the {{/libs/ignite-core*.jar}} file. Is it Ok for your case? > CPP: C++ node can't start without java examples folder > -- > > Key: IGNITE-7114 > URL: https://issues.apache.org/jira/browse/IGNITE-7114 > Project: Ignite > Issue Type: Bug > Components: platforms >Affects Versions: 2.1 >Reporter: Evgenii Zhuravlev >Assignee: Igor Sapego >Priority: Critical > Fix For: 2.4 > > Attachments: sample.png > > > Error message: > ERROR: Java classpath is empty (did you set {{IGNITE_HOME}} environment > variable?) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-369) Cache manager should switch cache statisticsEnabled property globaly
[ https://issues.apache.org/jira/browse/IGNITE-369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksey Plekhanov reassigned IGNITE-369: Assignee: Aleksey Plekhanov > Cache manager should switch cache statisticsEnabled property globaly > > > Key: IGNITE-369 > URL: https://issues.apache.org/jira/browse/IGNITE-369 > Project: Ignite > Issue Type: Task >Affects Versions: sprint-2 >Reporter: Alexey Kuznetsov >Assignee: Aleksey Plekhanov > > Also you should take care about new nodes that joining grid. > New node could have statisticsEnabled with opposite value that nodes in grid. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (IGNITE-7140) Error in cardinality checks in AbstractMatrix in methods plus and minus
Artem Malykh created IGNITE-7140: Summary: Error in cardinality checks in AbstractMatrix in methods plus and minus Key: IGNITE-7140 URL: https://issues.apache.org/jira/browse/IGNITE-7140 Project: Ignite Issue Type: Bug Reporter: Artem Malykh Assignee: Artem Malykh Cardinality checks in mentioned methods compare matrix dimensions with its own dimensions instead of operands dimensions. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (IGNITE-7044) SQL: Documentation for the PARALLEL statement in the CREATE INDEX command
[ https://issues.apache.org/jira/browse/IGNITE-7044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281808#comment-16281808 ] Vladimir Ozerov edited comment on IGNITE-7044 at 12/7/17 12:55 PM: --- [~dmagda], [~rkondakov], these operations have nothing in common. Query parallelism splits indexes into multiple pieces. We will deprecate it in future in favor of intellectual parallel execution based on statistics. {{CREATE INDEX}} parallelism defines how many threads will fill index with data during creation. was (Author: vozerov): [~dmagda], [~rkondakov], these operations have nothing in common. > SQL: Documentation for the PARALLEL statement in the CREATE INDEX command > - > > Key: IGNITE-7044 > URL: https://issues.apache.org/jira/browse/IGNITE-7044 > Project: Ignite > Issue Type: Task > Components: documentation >Affects Versions: 2.1 >Reporter: Roman Kondakov >Assignee: Roman Kondakov > Fix For: 2.4 > > > Add a documentation for the PARALLEL option in the CREATE INDEX command. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7044) SQL: Documentation for the PARALLEL statement in the CREATE INDEX command
[ https://issues.apache.org/jira/browse/IGNITE-7044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281808#comment-16281808 ] Vladimir Ozerov commented on IGNITE-7044: - [~dmagda], [~rkondakov], these operations have nothing in common. > SQL: Documentation for the PARALLEL statement in the CREATE INDEX command > - > > Key: IGNITE-7044 > URL: https://issues.apache.org/jira/browse/IGNITE-7044 > Project: Ignite > Issue Type: Task > Components: documentation >Affects Versions: 2.1 >Reporter: Roman Kondakov >Assignee: Roman Kondakov > Fix For: 2.4 > > > Add a documentation for the PARALLEL option in the CREATE INDEX command. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (IGNITE-6339) WAL: Avoid closed by interruption exception when user thread is interrupted
[ https://issues.apache.org/jira/browse/IGNITE-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281803#comment-16281803 ] Andrey Gura edited comment on IGNITE-6339 at 12/7/17 12:52 PM: --- As solution the following are implemented: - Ring buffer (see {{SegmentedRingByteBuffer}}) that reserve segment (buffer slice) for thread that want write WAL records. Thread serializes WAL records to the segment and calculate CRC if enabled. As result all threads serialize record in parallel manner to the ring buffer. - Dedicated single thread that handles fsync requests and flushes data from the ring buffer to the file channel. This thread can't be interrupted via public API in distinction of current implementation. Threads that initiate fsync will be parked until data will be flushed to disk. This solution solves problem with interrupts and improve WAL write performance for most cases in {{LOG_ONLY}} WAL mode. But this change leads to performance drop for cases when local thread writes data to the local node. It is valid for cases with 1-4 threads. For larger amount of thread we have better performance. In order to improve performance for case mentioned above we tried mapped file. This solution works very well and has better performance for any amount of threads. But {{MappedByteBuffer}} don't have method for partial fsync of data and for naive fsync ({{#force}} method) has performance drop for {{DEFAULT}} WAL mode. So we have three implementations: master, single writer and mmap. See rough benchmarks results below (throughput ops/sec): *BACKGROUND WAL mode* | Threads | master | single writer | mmap | | 1 | 70-80 K | 64-65 K | 70-80 K | | 2 | 127-128 K | 100-110 K | 127-128 K | | 4 | 190-200 K | 170-180 K | 190-200 K | | 8 | 220-230K | 220-230 K | 220-230 K | For {{BACKGROUND}} mode throughput values are comparable for all implementations. *LOG_ONLY WAL mode* | Threads | master | single writer | mmap | | 1 | 60-65 K | 36-37 K | 70-80 K | | 2 | 100-105 K | 60-70 K | 124-125 K | | 4 | 130-140 K | 100-110 K | 190-200 K | | 8 | 50-60 K | 150-160 K | 210-220 K | For {{LOG_ONLY}} mode single writer performs better than master for larger amount of threads. But mmap is the best. *DEFAULT WAL mode* | Threads | master | single writer | mmap | | 1 | 1 K | 1 K | 1 K | | 2 | 1-2 K | 1-2 K | 1 K | | 4 | 3-4 K | 3-4 K | 1 K | | 8 | 5-6 K | 5-6 K | 1 K | For {{DEFAULT}} mode we have performance drop with mmap. But it seems that partial fsync should solve it. Any way changes related with this issue allow switch between mmap and signle writer solution using system property. *Note*: single writer and mmap still use {{fileIO.close()}} call that is interruptible. So {{ClosedByInterruption}} exception still has a chance to be thrown. This problem is still in TODO's that should be fixed. was (Author: agura): As solution the following are implemented: - Ring buffer (see {{SegmentedRingByteBuffer}}) that reserve segment (buffer slice) for thread that want write WAL records. Thread serializes WAL records to the segment and calculate CRC if enabled. As result all threads serialize record in parallel manner to the ring buffer. - Dedicated single thread that handles fsync requests and flushes data from the ring buffer to the file channel. This thread can't be interrupted via public API in distinction of current implementation. Threads that initiate fsync will be parked until data will be flushed to disk. This solution solves problem with interrupts and improve WAL write performance for most cases in {{LOG_ONLY}} WAL mode. But this change leads to performance drop for cases when local thread writes data to the local node. It is valid for cases with 1-4 threads. For larger amount of thread we have better performance. In order to improve performance for case mentioned above we tried mapped file. This solution works very well and has better performance for any amount of threads. But {{MappedByteBuffer}} don't have method for partial fsync of data and for naive fsync ({{#force}} method) has performance drop for {{DEFAULT}} WAL mode. So we have three implementations: master, single writer and mmap. See rough benchmarks results below (throughput ops/sec): *BACKGROUND WAL mode* | Threads | master | single writer | mmap | | 1 | 70-80 K | 64-65 K | 70-80 K | | 2 | 127-128 K | 100-110 K | 127-128 K | | 4 | 190-200 K | 170-180 K | 190-200 K | | 8 | 220-230K | 220-230 K | 220-230 K | For {{BACKGROUND}} mode throughput values are comparable for all implementations. *LOG_ONLY WAL mode* | Threads | master | single writer | mmap | | 1 | 60-65 K | 36-37 K | 70-80 K | | 2 | 100-105 K | 60-70 K | 124-125 K | | 4 | 130-140 K | 100-110 K | 190-200 K | | 8 | 50-60 K | 150-160 K | 210-220 K | For {{LOG_ONLY}} mode single writer performs better than master for larger amount of threads. But mmap is the best.
[jira] [Commented] (IGNITE-6339) WAL: Avoid closed by interruption exception when user thread is interrupted
[ https://issues.apache.org/jira/browse/IGNITE-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281803#comment-16281803 ] Andrey Gura commented on IGNITE-6339: - As solution the following are implemented: - Ring buffer (see {{SegmentedRingByteBuffer}}) that reserve segment (buffer slice) for thread that want write WAL records. Thread serializes WAL records to the segment and calculate CRC if enabled. As result all threads serialize record in parallel manner to the ring buffer. - Dedicated single thread that handles fsync requests and flushes data from the ring buffer to the file channel. This thread can't be interrupted via public API in distinction of current implementation. Threads that initiate fsync will be parked until data will be flushed to disk. This solution solves problem with interrupts and improve WAL write performance for most cases in {{LOG_ONLY}} WAL mode. But this change leads to performance drop for cases when local thread writes data to the local node. It is valid for cases with 1-4 threads. For larger amount of thread we have better performance. In order to improve performance for case mentioned above we tried mapped file. This solution works very well and has better performance for any amount of threads. But {{MappedByteBuffer}} don't have method for partial fsync of data and for naive fsync ({{#force}} method) has performance drop for {{DEFAULT}} WAL mode. So we have three implementations: master, single writer and mmap. See rough benchmarks results below (throughput ops/sec): *BACKGROUND WAL mode* | Threads | master | single writer | mmap | | 1 | 70-80 K | 64-65 K | 70-80 K | | 2 | 127-128 K | 100-110 K | 127-128 K | | 4 | 190-200 K | 170-180 K | 190-200 K | | 8 | 220-230K | 220-230 K | 220-230 K | For {{BACKGROUND}} mode throughput values are comparable for all implementations. *LOG_ONLY WAL mode* | Threads | master | single writer | mmap | | 1 | 60-65 K | 36-37 K | 70-80 K | | 2 | 100-105 K | 60-70 K | 124-125 K | | 4 | 130-140 K | 100-110 K | 190-200 K | | 8 | 50-60 K | 150-160 K | 210-220 K | For {{LOG_ONLY}} mode single writer performs better than master for larger amount of threads. But mmap is the best. *DEFAULT WAL mode* | Threads | master | single writer | mmap | | 1 | 1 K | 1 K | 1 K | | 2 | 1-2 K | 1-2 K | 1 K | | 4 | 3-4 K | 3-4 K | 1 K | | 8 | 5-6 K | 5-6 K | 1 K | For {{DEFAULT}} mode we have performance drop with mmap. But it seems that partial fsync should solve it. Any way changes related with this issue allow switch between mmap and signle writer solution using system property. *Note*: single writer and mmap still use {{fileIO.close()}} call that is interruptible. So "closed by interruption" exception still has a chance to be thrown. This problem is still in TODO's that should be fixed. > WAL: Avoid closed by interruption exception when user thread is interrupted > --- > > Key: IGNITE-6339 > URL: https://issues.apache.org/jira/browse/IGNITE-6339 > Project: Ignite > Issue Type: Bug > Components: persistence >Reporter: Andrey Gura >Assignee: Andrey Gura >Priority: Blocker > Labels: important > Fix For: 2.4 > > > We should have a separate writer thread for WAL that will write completed > serialized chunks of data. This will allow us avoid closed by interruption > exception when user thread is interrupted. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7088) Wrong implementation of DIRECT comparator for ordering cache start operations
[ https://issues.apache.org/jira/browse/IGNITE-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281799#comment-16281799 ] ASF GitHub Bot commented on IGNITE-7088: Github user asfgit closed the pull request at: https://github.com/apache/ignite/pull/3136 > Wrong implementation of DIRECT comparator for ordering cache start operations > - > > Key: IGNITE-7088 > URL: https://issues.apache.org/jira/browse/IGNITE-7088 > Project: Ignite > Issue Type: Bug >Affects Versions: 2.3 >Reporter: Evgenii Zhuravlev >Assignee: Evgenii Zhuravlev >Priority: Critical > Fix For: 2.4 > > > {code:java} > java.lang.IllegalArgumentException: Comparison method violates its general > contract! > at java.util.TimSort.mergeHi(TimSort.java:899) ~[?:1.8.0_102] > at java.util.TimSort.mergeAt(TimSort.java:516) ~[?:1.8.0_102] > at java.util.TimSort.mergeForceCollapse(TimSort.java:457) ~[?:1.8.0_102] > at java.util.TimSort.sort(TimSort.java:254) ~[?:1.8.0_102] > at java.util.Arrays.sort(Arrays.java:1512) ~[?:1.8.0_102] > at java.util.ArrayList.sort(ArrayList.java:1454) ~[?:1.8.0_102] > at java.util.Collections.sort(Collections.java:175) ~[?:1.8.0_102] > at > org.apache.ignite.internal.processors.cache.ClusterCachesInfo.orderedCaches(ClusterCachesInfo.java:1616) > ~[ignite-core-2.1.7.jar:2.1.7] > at > org.apache.ignite.internal.processors.cache.ClusterCachesInfo.cachesReceivedFromJoin(ClusterCachesInfo.java:839) > ~[ignite-core-2.1.7.jar:2.1.7] > at > org.apache.ignite.internal.processors.cache.GridCacheProcessor.startReceivedCaches(GridCacheProcessor.java:1709) > ~[ignite-core-2.1.7.jar:2.1.7] > at > org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:606) > [ignite-core-2.1.7.jar:2.1.7] > at > org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:2278) > [ignite-core-2.1.7.jar:2.1.7] > at > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) > [ignite-core-2.1.7.jar:2.1.7] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_102] > {code} > When 2 not user caches will be compared using this comparator, this above > exception will be thrown. > As a workaround can be used system variable > -Djava.util.Arrays.useLegacyMergeSort=true -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-7113) "Key is missing from query" when creating table with key_type=java.lang.String
[ https://issues.apache.org/jira/browse/IGNITE-7113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Paschenko reassigned IGNITE-7113: --- Assignee: Alexander Paschenko > "Key is missing from query" when creating table with key_type=java.lang.String > -- > > Key: IGNITE-7113 > URL: https://issues.apache.org/jira/browse/IGNITE-7113 > Project: Ignite > Issue Type: Bug > Components: sql >Affects Versions: 2.3 >Reporter: Ilya Kasnacheev >Assignee: Alexander Paschenko > Attachments: IgniteStringKeyTest.java > > > When creating a table of > {code} > CREATE TABLE IF NOT EXISTS TableWithStringKey ( > ID VARCHAR PRIMARY KEY, > DataNodeId VARCHAR > ) WITH "backups=1, cache_name=TableWithStringKey, atomicity=transactional, > key_type=java.lang.String, value_type=TableWithStringKey" > {code} > and attempting an insert later > {code} > INSERT INTO TableWithStringKey (ID, DataNodeId) VALUES ('ref2', 'src2') > {code} > There's suddently an exception > {code} > javax.cache.CacheException: class > org.apache.ignite.internal.processors.query.IgniteSQLException: Failed to > execute DML statement [stmt=INSERT INTO TableWithStringKey (ID, DataNodeId) > VALUES ('ref2', 'src2'), params=null] > at > org.apache.ignite.internal.processors.cache.IgniteCacheProxyImpl.query(IgniteCacheProxyImpl.java:597) > at > org.apache.ignite.internal.processors.cache.IgniteCacheProxyImpl.query(IgniteCacheProxyImpl.java:560) > at > org.apache.ignite.internal.processors.cache.GatewayProtectedCacheProxy.query(GatewayProtectedCacheProxy.java:382) > at > com.gridgain.reproducer.IgniteStringKeyTest.insertTest(IgniteStringKeyTest.java:34) > ... 24 more > Caused by: class > org.apache.ignite.internal.processors.query.IgniteSQLException: Failed to > execute DML statement [stmt=INSERT INTO TableWithStringKey (ID, DataNodeId) > VALUES ('ref2', 'src2'), params=null] > at > org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing.queryDistributedSqlFields(IgniteH2Indexing.java:1459) > at > org.apache.ignite.internal.processors.query.GridQueryProcessor$5.applyx(GridQueryProcessor.java:1909) > at > org.apache.ignite.internal.processors.query.GridQueryProcessor$5.applyx(GridQueryProcessor.java:1907) > at > org.apache.ignite.internal.util.lang.IgniteOutClosureX.apply(IgniteOutClosureX.java:36) > at > org.apache.ignite.internal.processors.query.GridQueryProcessor.executeQuery(GridQueryProcessor.java:2445) > at > org.apache.ignite.internal.processors.query.GridQueryProcessor.querySqlFields(GridQueryProcessor.java:1914) > at > org.apache.ignite.internal.processors.cache.IgniteCacheProxyImpl.query(IgniteCacheProxyImpl.java:585) > ... 27 more > Caused by: class org.apache.ignite.IgniteCheckedException: Key is missing > from query > at > org.apache.ignite.internal.processors.query.h2.dml.UpdatePlanBuilder.createSupplier(UpdatePlanBuilder.java:369) > at > org.apache.ignite.internal.processors.query.h2.dml.UpdatePlanBuilder.planForInsert(UpdatePlanBuilder.java:211) > at > org.apache.ignite.internal.processors.query.h2.dml.UpdatePlanBuilder.planForStatement(UpdatePlanBuilder.java:98) > at > org.apache.ignite.internal.processors.query.h2.DmlStatementsProcessor.getPlanForStatement(DmlStatementsProcessor.java:473) > at > org.apache.ignite.internal.processors.query.h2.DmlStatementsProcessor.updateSqlFields(DmlStatementsProcessor.java:170) > at > org.apache.ignite.internal.processors.query.h2.DmlStatementsProcessor.updateSqlFieldsDistributed(DmlStatementsProcessor.java:229) > at > org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing.queryDistributedSqlFields(IgniteH2Indexing.java:1453) > ... 33 more > {code} > that goes away if you remove "key_type=java.lang.String" > I'm attaching a reproducer class. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-4192) SQL TX: JDBC driver support
[ https://issues.apache.org/jira/browse/IGNITE-4192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281782#comment-16281782 ] ASF GitHub Bot commented on IGNITE-4192: GitHub user alexpaschenko opened a pull request: https://github.com/apache/ignite/pull/3169 IGNITE-4192 You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-4192 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/ignite/pull/3169.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3169 commit f6e982540e65ab17d439dba990794f35616a30dd Author: sboikovDate: 2017-08-30T09:45:40Z ignite-3478 commit 275a85db5cd6923b36126166ae99b15e876192be Author: sboikov Date: 2017-08-31T07:44:07Z Merge remote-tracking branch 'remotes/origin/master' into ignite-3478 commit b7b9089f0102b8cab9942a9c887d93e9f26cc7d2 Author: sboikov Date: 2017-08-31T09:00:36Z disco cache cleanup commit 855c2d45794c300d41e386b4e6fa40736cc3e40d Author: sboikov Date: 2017-08-31T09:09:58Z Merge branch 'ignite-3478-1' into ignite-3478 commit 08be7310a93d3ce455215b97cf8ab1a2c3f0ab31 Author: sboikov Date: 2017-08-31T09:52:23Z ignite-3478 commit fce2e31f0fd2f4f6a9944422e40408a0c65cfe90 Author: sboikov Date: 2017-09-04T08:13:50Z Merge remote-tracking branch 'remotes/origin/master' into ignite-3478 commit d3c049952384750c5543a9f88b383c033ef74096 Author: sboikov Date: 2017-09-04T08:52:11Z ignite-3478 commit e71ce1937a18dd32448e92b1038dc48d4cb6f8ab Author: sboikov Date: 2017-09-04T10:16:03Z ignite-3478 commit 5fac5b0965e97f8951e16e10ca9229a2e78ddb0c Author: sboikov Date: 2017-09-05T10:16:44Z Merge remote-tracking branch 'remotes/origin/master' into ignite-3478 # Conflicts: # modules/core/src/main/java/org/apache/ignite/internal/processors/cache/distributed/dht/GridDhtTxPrepareFuture.java commit 2e0c9c08e046e8d6af1b5358d9053eae999b1fb4 Author: sboikov Date: 2017-09-05T11:30:55Z ignite-3478 commit e1e07ffdf2d711ba3e72f316f5a3970eff27372e Author: sboikov Date: 2017-09-05T11:31:14Z ignite-3478 commit cbada3934a386668da0b11d4de7d0f58a4d04dfe Author: sboikov Date: 2017-09-05T11:49:49Z ignite-3484 commit 5a82c68dcd1927bb6fded8b7def38c91ff6e145b Author: sboikov Date: 2017-09-05T11:59:49Z Merge remote-tracking branch 'remotes/origin/master' into ignite-3478 commit bc9134c94b7a738dc1664e96ca6eabb059f1c268 Author: sboikov Date: 2017-09-05T12:03:39Z Merge branch 'ignite-3478' into ignite-3484 # Conflicts: # modules/core/src/main/java/org/apache/ignite/internal/processors/cache/tree/AbstractDataInnerIO.java commit b4bfcde78825c6517232e49d389bdb5de19f05a9 Author: sboikov Date: 2017-09-05T12:27:51Z ignite-3484 commit 43834aaab9e2c3cd5fdd55289fdc4a9ff8ab6599 Author: sboikov Date: 2017-09-05T13:13:00Z ignite-3478 commit d1b828095713fcadfa260cf94fef01b42a1b12fd Author: sboikov Date: 2017-09-05T13:13:33Z Merge branch 'ignite-3478' into ignite-3484 commit 6be6779b6336c36cd71eef0a25199a6a877ce6b5 Author: sboikov Date: 2017-09-05T13:47:11Z ignite-3484 commit e3bba83256c1eb53c4b40fbd9ddba47fcf9d58d5 Author: sboikov Date: 2017-09-06T07:10:26Z ignite-3484 commit dd0afb28466094b801506da8afa3601bfaebd853 Author: sboikov Date: 2017-09-06T07:30:04Z ignite-3484 commit 27b87b413348b03986a463551db24b7726321732 Author: sboikov Date: 2017-09-06T08:19:18Z Merge remote-tracking branch 'remotes/origin/master' into ignite-3478 # Conflicts: # modules/core/src/main/java/org/apache/ignite/internal/processors/cache/distributed/dht/GridDhtTxPrepareFuture.java commit dcaf8801accd6ee089849a82b2ccd558aec81895 Author: sboikov Date: 2017-09-06T08:19:30Z Merge remote-tracking branch 'remotes/origin/master' into ignite-3478 # Conflicts: # modules/core/src/main/java/org/apache/ignite/internal/processors/cache/distributed/dht/GridDhtTxPrepareFuture.java commit c966451d0bf7059575de92bcfae43d72096ebce4 Author: sboikov Date: 2017-09-06T08:27:04Z Merge branch 'ignite-3478' into ignite-3484 commit 91b9911731a387a3199ddbbc22704bc14af09995 Author: sboikov
[jira] [Created] (IGNITE-7139) SQL: Implement a lazy execution for the local queries.
Roman Kondakov created IGNITE-7139: -- Summary: SQL: Implement a lazy execution for the local queries. Key: IGNITE-7139 URL: https://issues.apache.org/jira/browse/IGNITE-7139 Project: Ignite Issue Type: Improvement Components: sql Affects Versions: 2.3 Reporter: Roman Kondakov Fix For: 2.4 At the moment a lazy execution is implemented for the distributed queries only (see {{GridMapQueryExecutor}}). We need to add this feature for the local queries too. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7114) CPP: C++ node can't start without java examples folder
[ https://issues.apache.org/jira/browse/IGNITE-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281747#comment-16281747 ] Alexey Popov commented on IGNITE-7114: -- just FYI, sample files for regexp: ignite-core-2.1.7-p1.jar ignite-core-2.1.7.b3.jar > CPP: C++ node can't start without java examples folder > -- > > Key: IGNITE-7114 > URL: https://issues.apache.org/jira/browse/IGNITE-7114 > Project: Ignite > Issue Type: Bug > Components: platforms >Affects Versions: 2.1 >Reporter: Evgenii Zhuravlev >Assignee: Igor Sapego >Priority: Critical > Fix For: 2.4 > > Attachments: sample.png > > > Error message: > ERROR: Java classpath is empty (did you set {{IGNITE_HOME}} environment > variable?) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (IGNITE-7138) BinaryMetadata should be marshalled with standard JdkMarshaller instead of BinaryMarshaller
Sergey Chugunov created IGNITE-7138: --- Summary: BinaryMetadata should be marshalled with standard JdkMarshaller instead of BinaryMarshaller Key: IGNITE-7138 URL: https://issues.apache.org/jira/browse/IGNITE-7138 Project: Ignite Issue Type: Bug Reporter: Sergey Chugunov Fix For: 3.0 When running in persistent-enabled mode each Ignite node writes all updates of BinaryMetadata to local file system right from discovery thread. On writing metadata has to be marshalled into byte array, BinaryMarshaller is used at the moment (see BinaryMetadataFileStore class for implementation). It turned out it can cause a deadlock (more details are in linked ticket) when BinaryMarshaller decides to register metadata for one of the fields of initial BinaryMetadata object. JdkMarshaller should be used instead as it doesn't rely on internal mechanics of Ignite node. As it breaks compatibility this change cannot be implemented in 2.x version. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-6187) Cache JdbcDatabaseMetadata in JdbcConnection
[ https://issues.apache.org/jira/browse/IGNITE-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281739#comment-16281739 ] Ilya Kasnacheev commented on IGNITE-6187: - I don't think it makes any sense because it will call updateMetaData() every time on any non-trivial call, thus doing full amount of work. Otherwise, JdbcDatabaseMetadata is lightweight. Unless we have specific complaints about metadata performance it should be kept that way, I think. > Cache JdbcDatabaseMetadata in JdbcConnection > > > Key: IGNITE-6187 > URL: https://issues.apache.org/jira/browse/IGNITE-6187 > Project: Ignite > Issue Type: Improvement > Components: jdbc >Affects Versions: 2.1 >Reporter: Ilya Kasnacheev >Assignee: Ilya Kasnacheev > > To avoid re-creating it every time -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (IGNITE-6187) Cache JdbcDatabaseMetadata in JdbcConnection
[ https://issues.apache.org/jira/browse/IGNITE-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilya Kasnacheev resolved IGNITE-6187. - Resolution: Won't Fix > Cache JdbcDatabaseMetadata in JdbcConnection > > > Key: IGNITE-6187 > URL: https://issues.apache.org/jira/browse/IGNITE-6187 > Project: Ignite > Issue Type: Improvement > Components: jdbc >Affects Versions: 2.1 >Reporter: Ilya Kasnacheev >Assignee: Ilya Kasnacheev > > To avoid re-creating it every time -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7114) CPP: C++ node can't start without java examples folder
[ https://issues.apache.org/jira/browse/IGNITE-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281740#comment-16281740 ] Alexey Popov commented on IGNITE-7114: -- [~isapego], Please look through the attached sample.png. Can you please check the absence of "-x.y.z" part with some error indication as well. That's a real-world example ) > CPP: C++ node can't start without java examples folder > -- > > Key: IGNITE-7114 > URL: https://issues.apache.org/jira/browse/IGNITE-7114 > Project: Ignite > Issue Type: Bug > Components: platforms >Affects Versions: 2.1 >Reporter: Evgenii Zhuravlev >Assignee: Igor Sapego >Priority: Critical > Fix For: 2.4 > > Attachments: sample.png > > > Error message: > ERROR: Java classpath is empty (did you set {{IGNITE_HOME}} environment > variable?) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (IGNITE-7114) CPP: C++ node can't start without java examples folder
[ https://issues.apache.org/jira/browse/IGNITE-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Popov updated IGNITE-7114: - Attachment: sample.png > CPP: C++ node can't start without java examples folder > -- > > Key: IGNITE-7114 > URL: https://issues.apache.org/jira/browse/IGNITE-7114 > Project: Ignite > Issue Type: Bug > Components: platforms >Affects Versions: 2.1 >Reporter: Evgenii Zhuravlev >Assignee: Igor Sapego >Priority: Critical > Fix For: 2.4 > > Attachments: sample.png > > > Error message: > ERROR: Java classpath is empty (did you set {{IGNITE_HOME}} environment > variable?) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (IGNITE-7114) CPP: C++ node can't start without java examples folder
[ https://issues.apache.org/jira/browse/IGNITE-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Popov updated IGNITE-7114: - Attachment: (was: kodiak.png) > CPP: C++ node can't start without java examples folder > -- > > Key: IGNITE-7114 > URL: https://issues.apache.org/jira/browse/IGNITE-7114 > Project: Ignite > Issue Type: Bug > Components: platforms >Affects Versions: 2.1 >Reporter: Evgenii Zhuravlev >Assignee: Igor Sapego >Priority: Critical > Fix For: 2.4 > > > Error message: > ERROR: Java classpath is empty (did you set {{IGNITE_HOME}} environment > variable?) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (IGNITE-7114) CPP: C++ node can't start without java examples folder
[ https://issues.apache.org/jira/browse/IGNITE-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Popov updated IGNITE-7114: - Attachment: kodiak.png > CPP: C++ node can't start without java examples folder > -- > > Key: IGNITE-7114 > URL: https://issues.apache.org/jira/browse/IGNITE-7114 > Project: Ignite > Issue Type: Bug > Components: platforms >Affects Versions: 2.1 >Reporter: Evgenii Zhuravlev >Assignee: Igor Sapego >Priority: Critical > Fix For: 2.4 > > Attachments: kodiak.png > > > Error message: > ERROR: Java classpath is empty (did you set {{IGNITE_HOME}} environment > variable?) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-6872) Linear regression should implement Model API
[ https://issues.apache.org/jira/browse/IGNITE-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281729#comment-16281729 ] ASF GitHub Bot commented on IGNITE-6872: GitHub user oignatenko opened a pull request: https://github.com/apache/ignite/pull/3168 IGNITE-6872 Linear regression should implement Model API Model and Trainer API implemented for OLS regression You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-6872-4 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/ignite/pull/3168.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3168 commit cf6ba40c97840a28ee14f49f09f79fe3d9d5a66f Author: Oleg IgnatenkoDate: 2017-11-20T11:53:46Z IGNITE-6872 Linear regression should implement Model API - regression examples moved to more appropriate package -- verified with diffs overview, clean build and execution of unit tests commit a8dadee71e0ca2a00387cfa2dba9c656de75137f Author: Oleg Ignatenko Date: 2017-11-20T11:57:18Z IGNITE-6872 Linear regression should implement Model API - added missing package-info -- verified with diffs overview commit cc8edfbd0ca7e20655f45dc82d576f2d21627497 Author: Oleg Ignatenko Date: 2017-11-20T14:12:03Z IGNITE-6872 Linear regression should implement Model API - implementation, tests and examples - accommodated changes done to OLS per IGNITE-5846 - fixed some issues with coding style and javadoc -- verified with diffs overview, clean build, execution of unit tests and examples commit a0f294740b78dbe354a67a1658c9877544e587ea Author: Oleg Ignatenko Date: 2017-11-21T08:57:27Z IGNITE-6872 Linear regression should implement Model API - decision trees example moved to more appropriate package -- verified with diffs overview commit e944568849d09f2bc7fca932bc043304208ff55d Author: Oleg Ignatenko Date: 2017-11-21T13:25:31Z IGNITE-6872 Linear regression should implement Model API - corrections per review -- verified with diffs overview commit dfa4ea896d404b7bd231b57e880b5745b9db634f Author: Oleg Ignatenko Date: 2017-11-21T13:37:47Z IGNITE-6872 Linear regression should implement Model API - corrections per review -- verified with diffs overview commit fe79868659d9a04d73234d800b7e5b1ba9029eeb Author: Oleg Ignatenko Date: 2017-11-21T13:38:19Z IGNITE-6872 Linear regression should implement Model API - corrections per review -- verified with diffs overview commit c69583b91eef73616827cbfe03ad9eb1ff7ccde0 Author: Oleg Ignatenko Date: 2017-11-21T13:42:56Z IGNITE-6872 Linear regression should implement Model API - corrections per review -- verified with diffs overview commit 1ca1fb030d5be32843fce9746aa7d026a81d4502 Author: Oleg Ignatenko Date: 2017-11-21T13:45:15Z IGNITE-6872 Linear regression should implement Model API - corrections per review -- verified with diffs overview commit 35918b024bca13dea3a061f623f743ab33f14cd7 Author: Oleg Ignatenko Date: 2017-11-21T13:49:53Z IGNITE-6872 Linear regression should implement Model API - corrections per review -- verified with diffs overview, clean build, execution of unit tests and examples commit 88fe344b83b9c9272eddc1c6e536febb0f8eff43 Author: Oleg Ignatenko Date: 2017-11-23T14:50:47Z IGNITE-6872 Linear regression should implement Model API - OLS regression Trainer wip - preliminary cleanup of QR decomposition -- verified with diffs overview, clean build, execution of unit tests and examples commit 24a27d9976fe5c1cf3ab876e410b4af63aec8792 Author: Oleg Ignatenko Date: 2017-11-23T15:26:20Z IGNITE-6872 Linear regression should implement Model API - OLS regression Trainer wip - adapter from QR decomposition to trainer -- verified with diffs overview, clean build and execution of unit tests commit 608d558fa33e61d86b35621ea706819621a017ba Author: Oleg Ignatenko Date: 2017-11-27T16:16:19Z IGNITE-6872 Linear regression should implement Model API - OLS regression Trainer implemented -- verified with diffs overview, clean build, execution of unit tests and examples commit 857c0f83a281f9a37664988a50f2924f26140f47 Author: Oleg Ignatenko Date: 2017-12-07T11:04:41Z Merge branch 'ignite-6872-2' into ignite-6872-4 # Conflicts: #
[jira] [Commented] (IGNITE-6872) Linear regression should implement Model API
[ https://issues.apache.org/jira/browse/IGNITE-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281728#comment-16281728 ] ASF GitHub Bot commented on IGNITE-6872: Github user oignatenko closed the pull request at: https://github.com/apache/ignite/pull/3167 > Linear regression should implement Model API > > > Key: IGNITE-6872 > URL: https://issues.apache.org/jira/browse/IGNITE-6872 > Project: Ignite > Issue Type: Task > Components: ml >Reporter: Oleg Ignatenko >Assignee: Oleg Ignatenko > Fix For: 2.4 > > > When linear regression was originally implemented per IGNITE-5012 we had no > Model API. > Now that this API is available (merged into master with IGNITE-5218) lin > regression needs to adapt to implement it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (IGNITE-6872) Linear regression should implement Model API
[ https://issues.apache.org/jira/browse/IGNITE-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267012#comment-16267012 ] Oleg Ignatenko edited comment on IGNITE-6872 at 12/7/17 11:24 AM: -- [~chief] - I drafted implementation with Trainer API in branch [ignite-6872-4|https://github.com/gridgain/apache-ignite/tree/ignite-6872-4], would appreciate if you take a look. was (Author: oignatenko): [~chief] - I drafted implementation with Trainer API in branch [ignite-6872-3|https://github.com/gridgain/apache-ignite/tree/ignite-6872-3], would appreciate if you take a look. > Linear regression should implement Model API > > > Key: IGNITE-6872 > URL: https://issues.apache.org/jira/browse/IGNITE-6872 > Project: Ignite > Issue Type: Task > Components: ml >Reporter: Oleg Ignatenko >Assignee: Oleg Ignatenko > Fix For: 2.4 > > > When linear regression was originally implemented per IGNITE-5012 we had no > Model API. > Now that this API is available (merged into master with IGNITE-5218) lin > regression needs to adapt to implement it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-4835) Add ability to start rebalancing from management console
[ https://issues.apache.org/jira/browse/IGNITE-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Konstantinov reassigned IGNITE-4835: -- Assignee: Alexey Kuznetsov (was: Pavel Konstantinov) > Add ability to start rebalancing from management console > > > Key: IGNITE-4835 > URL: https://issues.apache.org/jira/browse/IGNITE-4835 > Project: Ignite > Issue Type: New Feature > Components: wizards >Affects Versions: 1.9 >Reporter: Alexandr Fedotov >Assignee: Alexey Kuznetsov >Priority: Minor > > Management console should allow for starting rebalancing manually. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-6171) Native facility to control excessive GC pauses
[ https://issues.apache.org/jira/browse/IGNITE-6171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281641#comment-16281641 ] Dmitriy Sorokin commented on IGNITE-6171: - [~avinogradov], review new patch, please! > Native facility to control excessive GC pauses > -- > > Key: IGNITE-6171 > URL: https://issues.apache.org/jira/browse/IGNITE-6171 > Project: Ignite > Issue Type: Task > Components: general >Affects Versions: 2.3 >Reporter: Vladimir Ozerov >Assignee: Dmitriy Sorokin > Labels: iep-7, usability > Fix For: 2.4 > > > Ignite is Java-based application. If node experiences long GC pauses it may > negatively affect other nodes. We need to find a way to detect long GC pauses > within the process and trigger some actions in response, e.g. node stop. > This is a kind of Inception \[1\], when you need to understand that you sleep > while sleeping. As all Java threads are blocked on safepoint, we cannot use > Java's thread to detect Java's GC. Native threads should be used instead. > Proposed solution: > 1) Thread 1 should periodically call dummy JNI method returning current time, > and set this time to shared variable; > 2) Thread 2 should periodically check that variable. If it has not been > changed for some time - most likely we are in GC pause. Once certain > threashold is reached - trigger compensating action, whether this is a > warning, process kill, or what so ever. > Justification: crossing native -> Java boundaries involves safepoints. This > way Thread 1 will be trapped if STW pause is in progress. Java method cannot > be empty, as JVM is smart enough and can deduce it to no-op. > \[1\] http://www.imdb.com/title/tt1375666/ -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-4835) Add ability to start rebalancing from management console
[ https://issues.apache.org/jira/browse/IGNITE-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281643#comment-16281643 ] Pavel Konstantinov commented on IGNITE-4835: Tested. > Add ability to start rebalancing from management console > > > Key: IGNITE-4835 > URL: https://issues.apache.org/jira/browse/IGNITE-4835 > Project: Ignite > Issue Type: New Feature > Components: wizards >Affects Versions: 1.9 >Reporter: Alexandr Fedotov >Assignee: Pavel Konstantinov >Priority: Minor > > Management console should allow for starting rebalancing manually. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (IGNITE-6872) Linear regression should implement Model API
[ https://issues.apache.org/jira/browse/IGNITE-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267012#comment-16267012 ] Oleg Ignatenko edited comment on IGNITE-6872 at 12/7/17 10:21 AM: -- [~chief] - I drafted implementation with Trainer API in branch [ignite-6872-3|https://github.com/gridgain/apache-ignite/tree/ignite-6872-3], would appreciate if you take a look. was (Author: oignatenko): [~chief] - I drafted implementation with Trainer API in branch [ignite-6872-2|https://github.com/gridgain/apache-ignite/tree/ignite-6872-2], would appreciate if you take a look. > Linear regression should implement Model API > > > Key: IGNITE-6872 > URL: https://issues.apache.org/jira/browse/IGNITE-6872 > Project: Ignite > Issue Type: Task > Components: ml >Reporter: Oleg Ignatenko >Assignee: Oleg Ignatenko > Fix For: 2.4 > > > When linear regression was originally implemented per IGNITE-5012 we had no > Model API. > Now that this API is available (merged into master with IGNITE-5218) lin > regression needs to adapt to implement it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-6903) Implement new JMX metrics for Indexing
[ https://issues.apache.org/jira/browse/IGNITE-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281632#comment-16281632 ] Aleksey Plekhanov commented on IGNITE-6903: --- [~avinogradov], [~NIzhikov] Looks good to me. > Implement new JMX metrics for Indexing > -- > > Key: IGNITE-6903 > URL: https://issues.apache.org/jira/browse/IGNITE-6903 > Project: Ignite > Issue Type: New Feature >Reporter: Anton Vinogradov >Assignee: Nikolay Izhikov >Priority: Critical > Labels: iep-6, important > Fix For: 2.4 > > > These additional metrics and methods should be implemented: > - Space occupied by indexes. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-6872) Linear regression should implement Model API
[ https://issues.apache.org/jira/browse/IGNITE-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281629#comment-16281629 ] ASF GitHub Bot commented on IGNITE-6872: GitHub user oignatenko opened a pull request: https://github.com/apache/ignite/pull/3167 IGNITE-6872 Linear regression should implement Model API You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-6872-3 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/ignite/pull/3167.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3167 commit cf6ba40c97840a28ee14f49f09f79fe3d9d5a66f Author: Oleg IgnatenkoDate: 2017-11-20T11:53:46Z IGNITE-6872 Linear regression should implement Model API - regression examples moved to more appropriate package -- verified with diffs overview, clean build and execution of unit tests commit a8dadee71e0ca2a00387cfa2dba9c656de75137f Author: Oleg Ignatenko Date: 2017-11-20T11:57:18Z IGNITE-6872 Linear regression should implement Model API - added missing package-info -- verified with diffs overview commit cc8edfbd0ca7e20655f45dc82d576f2d21627497 Author: Oleg Ignatenko Date: 2017-11-20T14:12:03Z IGNITE-6872 Linear regression should implement Model API - implementation, tests and examples - accommodated changes done to OLS per IGNITE-5846 - fixed some issues with coding style and javadoc -- verified with diffs overview, clean build, execution of unit tests and examples commit a0f294740b78dbe354a67a1658c9877544e587ea Author: Oleg Ignatenko Date: 2017-11-21T08:57:27Z IGNITE-6872 Linear regression should implement Model API - decision trees example moved to more appropriate package -- verified with diffs overview commit e944568849d09f2bc7fca932bc043304208ff55d Author: Oleg Ignatenko Date: 2017-11-21T13:25:31Z IGNITE-6872 Linear regression should implement Model API - corrections per review -- verified with diffs overview commit dfa4ea896d404b7bd231b57e880b5745b9db634f Author: Oleg Ignatenko Date: 2017-11-21T13:37:47Z IGNITE-6872 Linear regression should implement Model API - corrections per review -- verified with diffs overview commit fe79868659d9a04d73234d800b7e5b1ba9029eeb Author: Oleg Ignatenko Date: 2017-11-21T13:38:19Z IGNITE-6872 Linear regression should implement Model API - corrections per review -- verified with diffs overview commit c69583b91eef73616827cbfe03ad9eb1ff7ccde0 Author: Oleg Ignatenko Date: 2017-11-21T13:42:56Z IGNITE-6872 Linear regression should implement Model API - corrections per review -- verified with diffs overview commit 1ca1fb030d5be32843fce9746aa7d026a81d4502 Author: Oleg Ignatenko Date: 2017-11-21T13:45:15Z IGNITE-6872 Linear regression should implement Model API - corrections per review -- verified with diffs overview commit 35918b024bca13dea3a061f623f743ab33f14cd7 Author: Oleg Ignatenko Date: 2017-11-21T13:49:53Z IGNITE-6872 Linear regression should implement Model API - corrections per review -- verified with diffs overview, clean build, execution of unit tests and examples commit 88fe344b83b9c9272eddc1c6e536febb0f8eff43 Author: Oleg Ignatenko Date: 2017-11-23T14:50:47Z IGNITE-6872 Linear regression should implement Model API - OLS regression Trainer wip - preliminary cleanup of QR decomposition -- verified with diffs overview, clean build, execution of unit tests and examples commit 24a27d9976fe5c1cf3ab876e410b4af63aec8792 Author: Oleg Ignatenko Date: 2017-11-23T15:26:20Z IGNITE-6872 Linear regression should implement Model API - OLS regression Trainer wip - adapter from QR decomposition to trainer -- verified with diffs overview, clean build and execution of unit tests commit 608d558fa33e61d86b35621ea706819621a017ba Author: Oleg Ignatenko Date: 2017-11-27T16:16:19Z IGNITE-6872 Linear regression should implement Model API - OLS regression Trainer implemented -- verified with diffs overview, clean build, execution of unit tests and examples commit 6aca220e1a40609b5d2a283a338a9f9bdecdfe33 Author: Oleg Ignatenko Date: 2017-12-07T10:01:26Z Merge branch 'ignite-6872-2' into ignite-6872-3 # Conflicts: # modules/ml/src/test/java/org/apache/ignite/ml/LocalModelsTest.java #
[jira] [Commented] (IGNITE-7114) CPP: C++ node can't start without java examples folder
[ https://issues.apache.org/jira/browse/IGNITE-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281622#comment-16281622 ] Igor Sapego commented on IGNITE-7114: - [~ptupitsyn], agree. I'll try to implement proposed logic. > CPP: C++ node can't start without java examples folder > -- > > Key: IGNITE-7114 > URL: https://issues.apache.org/jira/browse/IGNITE-7114 > Project: Ignite > Issue Type: Bug > Components: platforms >Affects Versions: 2.1 >Reporter: Evgenii Zhuravlev >Assignee: Igor Sapego >Priority: Critical > Fix For: 2.4 > > > Error message: > ERROR: Java classpath is empty (did you set {{IGNITE_HOME}} environment > variable?) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-7135) IgniteCluster.startNodes() returns successful ClusterStartNodeResult even though the remote process fails
[ https://issues.apache.org/jira/browse/IGNITE-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexandr Kuramshin reassigned IGNITE-7135: -- Assignee: Alexandr Kuramshin > IgniteCluster.startNodes() returns successful ClusterStartNodeResult even > though the remote process fails > - > > Key: IGNITE-7135 > URL: https://issues.apache.org/jira/browse/IGNITE-7135 > Project: Ignite > Issue Type: Bug >Affects Versions: 2.3 >Reporter: Alexandr Kuramshin >Assignee: Alexandr Kuramshin > Labels: test > Fix For: 2.4 > > > After unsuccessful start of three remote nodes with > {{IgniteCluster#startNodes(Collection
[jira] [Commented] (IGNITE-7134) Never-ending timeout in IgniteSpiOperationTimeoutHelper.nextTimeoutChunk()
[ https://issues.apache.org/jira/browse/IGNITE-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281618#comment-16281618 ] ASF GitHub Bot commented on IGNITE-7134: GitHub user akuramshingg opened a pull request: https://github.com/apache/ignite/pull/3166 IGNITE-7134 Never-ending timeout in IgniteSpiOperationTimeoutHelper.nextTimeoutChunk(). You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-7134 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/ignite/pull/3166.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3166 commit 982f91a695442a4f2a63f7dc96761f7cc87a25cf Author: Alexandr KuramshinDate: 2017-12-07T10:10:02Z IGNITE-7134 Never-ending timeout in IgniteSpiOperationTimeoutHelper.nextTimeoutChunk(). > Never-ending timeout in IgniteSpiOperationTimeoutHelper.nextTimeoutChunk() > -- > > Key: IGNITE-7134 > URL: https://issues.apache.org/jira/browse/IGNITE-7134 > Project: Ignite > Issue Type: Bug > Components: general >Affects Versions: 2.3 >Reporter: Alexandr Kuramshin >Assignee: Alexandr Kuramshin >Priority: Critical > Fix For: 2.4 > > > {noformat} > org.apache.ignite.spi.IgniteSpiOperationTimeoutHelper#nextTimeoutChunk > long curTs = U.currentTimeMillis(); > timeout = timeout - (curTs - lastOperStartTs); > {noformat} > Timeout will not be decreased at all if delay between successive calls to > nextTimeoutChunk() is smaller than U.currentTimeMillis() discretization. Such > behaviour could be easily achieved when getting an error right after the > nextTimeoutChunk() invocation and do the retry. > Only rare calls (the first right before U.currentTimeMillis() and the second > right after that) may decrease timeout, so actual > IgniteSpiOperationTimeoutHelper timeout could be much bigger than the > failureDetectionTimeout. > My opinion to not split failureDetectionTimeout between network operations, > but initialize first operation timestamp at first call to nextTimeoutChunk(), > and then calculate the timeout as a difference between the current timestamp > and the first operation timestamp. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7088) Wrong implementation of DIRECT comparator for ordering cache start operations
[ https://issues.apache.org/jira/browse/IGNITE-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281555#comment-16281555 ] Alexey Goncharuk commented on IGNITE-7088: -- Looks good to me. > Wrong implementation of DIRECT comparator for ordering cache start operations > - > > Key: IGNITE-7088 > URL: https://issues.apache.org/jira/browse/IGNITE-7088 > Project: Ignite > Issue Type: Bug >Affects Versions: 2.3 >Reporter: Evgenii Zhuravlev >Assignee: Evgenii Zhuravlev >Priority: Critical > Fix For: 2.4 > > > {code:java} > java.lang.IllegalArgumentException: Comparison method violates its general > contract! > at java.util.TimSort.mergeHi(TimSort.java:899) ~[?:1.8.0_102] > at java.util.TimSort.mergeAt(TimSort.java:516) ~[?:1.8.0_102] > at java.util.TimSort.mergeForceCollapse(TimSort.java:457) ~[?:1.8.0_102] > at java.util.TimSort.sort(TimSort.java:254) ~[?:1.8.0_102] > at java.util.Arrays.sort(Arrays.java:1512) ~[?:1.8.0_102] > at java.util.ArrayList.sort(ArrayList.java:1454) ~[?:1.8.0_102] > at java.util.Collections.sort(Collections.java:175) ~[?:1.8.0_102] > at > org.apache.ignite.internal.processors.cache.ClusterCachesInfo.orderedCaches(ClusterCachesInfo.java:1616) > ~[ignite-core-2.1.7.jar:2.1.7] > at > org.apache.ignite.internal.processors.cache.ClusterCachesInfo.cachesReceivedFromJoin(ClusterCachesInfo.java:839) > ~[ignite-core-2.1.7.jar:2.1.7] > at > org.apache.ignite.internal.processors.cache.GridCacheProcessor.startReceivedCaches(GridCacheProcessor.java:1709) > ~[ignite-core-2.1.7.jar:2.1.7] > at > org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:606) > [ignite-core-2.1.7.jar:2.1.7] > at > org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:2278) > [ignite-core-2.1.7.jar:2.1.7] > at > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) > [ignite-core-2.1.7.jar:2.1.7] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_102] > {code} > When 2 not user caches will be compared using this comparator, this above > exception will be thrown. > As a workaround can be used system variable > -Djava.util.Arrays.useLegacyMergeSort=true -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (IGNITE-7137) Provide a way to switch off BaselineTopology validation of nodes joining the cluster
Sergey Chugunov created IGNITE-7137: --- Summary: Provide a way to switch off BaselineTopology validation of nodes joining the cluster Key: IGNITE-7137 URL: https://issues.apache.org/jira/browse/IGNITE-7137 Project: Ignite Issue Type: Improvement Components: persistence Reporter: Sergey Chugunov In specific circumstances like split-brain user may need an ability to switch BaselineTopology validation off for a period of time when the cluster is assembling back. To do so we need to provide an API to switch BaselineTopology validation on and off dynamically. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-7136) Add JMX metric for indexing to .Net
[ https://issues.apache.org/jira/browse/IGNITE-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281536#comment-16281536 ] Pavel Tupitsyn commented on IGNITE-7136: See also IGNITE-7128. > Add JMX metric for indexing to .Net > > > Key: IGNITE-7136 > URL: https://issues.apache.org/jira/browse/IGNITE-7136 > Project: Ignite > Issue Type: Sub-task > Components: platforms >Reporter: Nikolay Izhikov >Assignee: Pavel Tupitsyn > Labels: iep-6 > Fix For: 2.4 > > > New JMX metric implemented in IGNITE-6903. > We need to add support for this metric to .Net -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-7134) Never-ending timeout in IgniteSpiOperationTimeoutHelper.nextTimeoutChunk()
[ https://issues.apache.org/jira/browse/IGNITE-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexandr Kuramshin reassigned IGNITE-7134: -- Assignee: Alexandr Kuramshin > Never-ending timeout in IgniteSpiOperationTimeoutHelper.nextTimeoutChunk() > -- > > Key: IGNITE-7134 > URL: https://issues.apache.org/jira/browse/IGNITE-7134 > Project: Ignite > Issue Type: Bug > Components: general >Affects Versions: 2.3 >Reporter: Alexandr Kuramshin >Assignee: Alexandr Kuramshin >Priority: Critical > Fix For: 2.4 > > > {noformat} > org.apache.ignite.spi.IgniteSpiOperationTimeoutHelper#nextTimeoutChunk > long curTs = U.currentTimeMillis(); > timeout = timeout - (curTs - lastOperStartTs); > {noformat} > Timeout will not be decreased at all if delay between successive calls to > nextTimeoutChunk() is smaller than U.currentTimeMillis() discretization. Such > behaviour could be easily achieved when getting an error right after the > nextTimeoutChunk() invocation and do the retry. > Only rare calls (the first right before U.currentTimeMillis() and the second > right after that) may decrease timeout, so actual > IgniteSpiOperationTimeoutHelper timeout could be much bigger than the > failureDetectionTimeout. > My opinion to not split failureDetectionTimeout between network operations, > but initialize first operation timestamp at first call to nextTimeoutChunk(), > and then calculate the timeout as a difference between the current timestamp > and the first operation timestamp. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (IGNITE-7136) Add JMX metric for indexing to .Net
Nikolay Izhikov created IGNITE-7136: --- Summary: Add JMX metric for indexing to .Net Key: IGNITE-7136 URL: https://issues.apache.org/jira/browse/IGNITE-7136 Project: Ignite Issue Type: Sub-task Components: platforms Reporter: Nikolay Izhikov Assignee: Pavel Tupitsyn New JMX metric implemented in IGNITE-6903. We need to add support for this metric to .Net -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (IGNITE-7135) IgniteCluster.startNodes() returns successful ClusterStartNodeResult even though the remote process fails
Alexandr Kuramshin created IGNITE-7135: -- Summary: IgniteCluster.startNodes() returns successful ClusterStartNodeResult even though the remote process fails Key: IGNITE-7135 URL: https://issues.apache.org/jira/browse/IGNITE-7135 Project: Ignite Issue Type: Bug Affects Versions: 2.3 Reporter: Alexandr Kuramshin Fix For: 2.4 After unsuccessful start of three remote nodes with {{IgniteCluster#startNodes(Collection
[jira] [Commented] (IGNITE-6711) DataRegionMetrics#totalAllocatedPages is not valid after node restart
[ https://issues.apache.org/jira/browse/IGNITE-6711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281497#comment-16281497 ] Andrey Kuznetsov commented on IGNITE-6711: -- [~avinogradov], could you please review the fix? > DataRegionMetrics#totalAllocatedPages is not valid after node restart > - > > Key: IGNITE-6711 > URL: https://issues.apache.org/jira/browse/IGNITE-6711 > Project: Ignite > Issue Type: Bug > Components: general >Affects Versions: 2.2 >Reporter: Alexey Goncharuk >Assignee: Andrey Kuznetsov > Labels: newbie > Fix For: 2.4 > > > Currently, data region metric tracks total allocated pages by a callback on > page allocation. However, when a node with enabled persistence is started, > some of the pages are already allocated, which leads to an incorrect metric > value. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-6711) DataRegionMetrics#totalAllocatedPages is not valid after node restart
[ https://issues.apache.org/jira/browse/IGNITE-6711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281494#comment-16281494 ] ASF GitHub Bot commented on IGNITE-6711: GitHub user andrey-kuznetsov opened a pull request: https://github.com/apache/ignite/pull/3165 IGNITE-6711: TotalAllocatedPages metric fix. You can merge this pull request into a Git repository by running: $ git pull https://github.com/andrey-kuznetsov/ignite ignite-6711 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/ignite/pull/3165.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3165 commit e6c75e81b87ec7e4e2489dd6a96e2f5a0b3d0c89 Author: Andrey KuznetsovDate: 2017-12-07T08:23:47Z IGNITE-6711: TotalAllocatedPages metric fix. > DataRegionMetrics#totalAllocatedPages is not valid after node restart > - > > Key: IGNITE-6711 > URL: https://issues.apache.org/jira/browse/IGNITE-6711 > Project: Ignite > Issue Type: Bug > Components: general >Affects Versions: 2.2 >Reporter: Alexey Goncharuk >Assignee: Andrey Kuznetsov > Labels: newbie > Fix For: 2.4 > > > Currently, data region metric tracks total allocated pages by a callback on > page allocation. However, when a node with enabled persistence is started, > some of the pages are already allocated, which leads to an incorrect metric > value. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (IGNITE-4835) Add ability to start rebalancing from management console
[ https://issues.apache.org/jira/browse/IGNITE-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasiliy Sisko reassigned IGNITE-4835: - Assignee: Pavel Konstantinov (was: Vasiliy Sisko) > Add ability to start rebalancing from management console > > > Key: IGNITE-4835 > URL: https://issues.apache.org/jira/browse/IGNITE-4835 > Project: Ignite > Issue Type: New Feature > Components: wizards >Affects Versions: 1.9 >Reporter: Alexandr Fedotov >Assignee: Pavel Konstantinov >Priority: Minor > > Management console should allow for starting rebalancing manually. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (IGNITE-4835) Add ability to start rebalancing from management console
[ https://issues.apache.org/jira/browse/IGNITE-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281493#comment-16281493 ] Vasiliy Sisko commented on IGNITE-4835: --- Fixed check of not exist cache. Fixed check on scan of system cache. > Add ability to start rebalancing from management console > > > Key: IGNITE-4835 > URL: https://issues.apache.org/jira/browse/IGNITE-4835 > Project: Ignite > Issue Type: New Feature > Components: wizards >Affects Versions: 1.9 >Reporter: Alexandr Fedotov >Assignee: Vasiliy Sisko >Priority: Minor > > Management console should allow for starting rebalancing manually. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Closed] (IGNITE-7133) Web console: Improve ignite icon service interface to extendable
[ https://issues.apache.org/jira/browse/IGNITE-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kuznetsov closed IGNITE-7133. > Web console: Improve ignite icon service interface to extendable > > > Key: IGNITE-7133 > URL: https://issues.apache.org/jira/browse/IGNITE-7133 > Project: Ignite > Issue Type: Improvement > Components: wizards >Reporter: Dmitriy Shabalin >Assignee: Alexey Kuznetsov > Fix For: 2.4 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)