[jira] [Commented] (IGNITE-11310) SQL: Remove special interaction between query parallelism and distributed joins
[ https://issues.apache.org/jira/browse/IGNITE-11310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16768576#comment-16768576 ] Vladimir Ozerov commented on IGNITE-11310: -- All failures are unrelated. Merged. > SQL: Remove special interaction between query parallelism and distributed > joins > --- > > Key: IGNITE-11310 > URL: https://issues.apache.org/jira/browse/IGNITE-11310 > Project: Ignite > Issue Type: Task > Components: sql >Reporter: Vladimir Ozerov >Assignee: Vladimir Ozerov >Priority: Major > Fix For: 2.8 > > Time Spent: 0.5h > Remaining Estimate: 0h > > Currently we enable so-called "local distributed joins" when query is > executed locally with enabled parallelism. This behavior is not needed and > needs to be removed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-11310) SQL: Remove special interaction between query parallelism and distributed joins
[
https://issues.apache.org/jira/browse/IGNITE-11310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16768563#comment-16768563
]
Ignite TC Bot commented on IGNITE-11310:
{panel:title=-- Run :: All: Possible
Blockers|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1}
{color:#d04437}Cache 7{color} [[tests
1|https://ci.ignite.apache.org/viewLog.html?buildId=3084680]]
* IgniteCacheTestSuite7:
TxRollbackAsyncWithPersistenceTest.testSynchronousRollback - 0,0% fails in last
417 master runs.
{color:#d04437}Cache (Failover) 3{color} [[tests
2|https://ci.ignite.apache.org/viewLog.html?buildId=3084668]]
* IgniteCacheFailoverTestSuite3:
IgniteCachePutRetryTransactionalSelfTest.testExplicitTransactionRetriesSingleValue
- 0,2% fails in last 414 master runs.
{color:#d04437}Thin client: Python{color} [[tests 95 Exit Code
|https://ci.ignite.apache.org/viewLog.html?buildId=3084703]]
*
tests.test_cache_class.test_cache_binary_get_put[None-None-localhost-_SSLMethod_PROTOCOL_TLSv1_1-None-None-10800-None-False-ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES:!aNULL:!eNULL:!MD5-0-None]
*
tests.test_cache_class.test_cache_get_put[None-None-localhost-_SSLMethod_PROTOCOL_TLSv1_1-None-None-10800-None-False-ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES:!aNULL:!eNULL:!MD5-0-None]
*
tests.test_cache_class.test_cache_scan[None-None-localhost-_SSLMethod_PROTOCOL_TLSv1_1-None-None-10800-None-False-ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES:!aNULL:!eNULL:!MD5-0-None-1]
*
tests.test_cache_class.test_get_binary_type[None-None-localhost-_SSLMethod_PROTOCOL_TLSv1_1-None-None-10800-None-False-ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES:!aNULL:!eNULL:!MD5-0-None]
*
tests.test_cache_class_sql.test_sql_fields[None-None-localhost-_SSLMethod_PROTOCOL_TLSv1_1-None-None-10800-None-False-ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES:!aNULL:!eNULL:!MD5-0-None-1]
*
tests.test_cache_class.test_get_and_put_if_absent[None-None-localhost-_SSLMethod_PROTOCOL_TLSv1_1-None-None-10800-None-False-ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES:!aNULL:!eNULL:!MD5-0-None]
*
tests.test_cache_config.test_get_configuration[None-None-localhost-_SSLMethod_PROTOCOL_TLSv1_1-None-None-10800-None-False-ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES:!aNULL:!eNULL:!MD5-0-None]
*
tests.test_cache_class_sql.test_sql[None-None-localhost-_SSLMethod_PROTOCOL_TLSv1_1-None-None-10800-None-False-ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES:!aNULL:!eNULL:!MD5-0-None-1]
*
tests.test_binary.test_sql_write_as_binary[None-None-localhost-_SSLMethod_PROTOCOL_TLSv1_1-None-None-10800-None-False-ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES:!aNULL:!eNULL:!MD5-0-None]
*
tests.test_binary.test_sql_read_as_binary[None-None-localhost-_SSLMethod_PROTOCOL_TLSv1_1-None-None-10800-None-False-ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES:!aNULL:!eNULL:!MD5-0-None]
*
tests.test_binary.test_add_schema_to_binary_object[None-None-localhost-_SSLMethod_PROTOCOL_TLSv1_1-None-None-10800-None-False-ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES:!aNULL:!eNULL:!MD5-0-None]
*
tests.test_binary.test_nested_binary_objects[None-None-localhost-_SSLMethod_PROTOCOL_TLSv1_1-None-None-10800-None-False-ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES:!aNULL:!eNULL:!MD5-0-None]
*
tests.test_cache_class.test_cache_remove[None-None-localhost-_SSLMethod_PROTOCOL_TLSv1_1-None-None-10800-None-False-ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES:!aNULL:!eNULL:!MD5-0-None]
*
tests.test_cache_class.test_cache_create[None-None-localhost-_SSLMethod_PROTOCOL_TLSv1_1-None-None-10800-None-False-ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+HIGH:DH+HIGH:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+HIGH:RSA+3DES:!aNULL:!eNULL:!MD5-0-None]
*
[jira] [Commented] (IGNITE-11310) SQL: Remove special interaction between query parallelism and distributed joins
[ https://issues.apache.org/jira/browse/IGNITE-11310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16768135#comment-16768135 ] Vladimir Ozerov commented on IGNITE-11310: -- Fixed all failures. Most of them were caused by invalid changes to DML logic, I reverted them. New test run: https://ci.ignite.apache.org/viewQueued.html?itemId=3084726 > SQL: Remove special interaction between query parallelism and distributed > joins > --- > > Key: IGNITE-11310 > URL: https://issues.apache.org/jira/browse/IGNITE-11310 > Project: Ignite > Issue Type: Task > Components: sql >Reporter: Vladimir Ozerov >Assignee: Vladimir Ozerov >Priority: Major > Fix For: 2.8 > > Time Spent: 0.5h > Remaining Estimate: 0h > > Currently we enable so-called "local distributed joins" when query is > executed locally with enabled parallelism. This behavior is not needed and > needs to be removed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-11310) SQL: Remove special interaction between query parallelism and distributed joins
[
https://issues.apache.org/jira/browse/IGNITE-11310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767986#comment-16767986
]
Ignite TC Bot commented on IGNITE-11310:
{panel:title=-- Run :: All: Possible
Blockers|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1}
{color:#d04437}Platform .NET (Long Running){color} [[tests
2|https://ci.ignite.apache.org/viewLog.html?buildId=3079497]]
* exe: ExamplesTest.TestRemoteNodesClientMode(SqlDmlExample) - 0,0% fails in
last 379 master runs.
{color:#d04437}Platform .NET{color} [[tests
12|https://ci.ignite.apache.org/viewLog.html?buildId=3079493]]
* exe: CacheLinqTest.TestRemoveAll - 0,0% fails in last 580 master runs.
* exe: CacheLinqTest.TestRemoveAll - 0,0% fails in last 580 master runs.
* exe: CacheLinqTest.TestRemoveAll - 0,0% fails in last 580 master runs.
{color:#d04437}Queries 1{color} [[tests
46|https://ci.ignite.apache.org/viewLog.html?buildId=3079499]]
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSkipReducerOnUpdateDmlFlagSelfTest.testUpdateSetTableSubquery - 0,0%
fails in last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
H2DynamicColumnsServerBasicSelfTest.testComplexOperations - 0,0% fails in last
412 master runs.
* IgniteBinaryCacheQueryTestSuite:
GridCacheDynamicLoadOnClientTest.testClientJdbcUpdate - 0,0% fails in last 412
master runs.
* IgniteBinaryCacheQueryTestSuite:
H2DynamicColumnsClientBasicSelfTest.testComplexOperations - 0,0% fails in last
412 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteCacheMergeSqlQuerySelfTest.testMergeFromSubquery - 0,0% fails in last 412
master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSegmentedIndexMultiNodeSelfTest.testSegmentedIndex - 0,0% fails in
last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
GridCacheDynamicLoadOnClientPersistentTest.testClientJdbcUpdate - 0,0% fails in
last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSkipReducerOnUpdateDmlFlagSelfTest.testInsertFromSelectGroupBy - 0,0%
fails in last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
GridCacheCrossCacheQuerySelfTest.testMultiStatement - 0,0% fails in last 412
master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlNotNullConstraintTest.testNotNullCheckDmlInsertFromSelect - 0,0% fails
in last 411 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSkipReducerOnUpdateDmlFlagSelfTest.testDeleteTop - 0,0% fails in last
412 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSegmentedIndexSelfTest.testSegmentedIndex - 0,0% fails in last 412
master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlNotNullConstraintTest.testNotNullCheckDmlUpdateValues - 0,0% fails in
last 411 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSkipReducerOnUpdateDmlFlagSelfTest.testInsertFromSelectUnion - 0,0%
fails in last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSkipReducerOnUpdateDmlFlagSelfTest.testUpdateWhereSubquery - 0,0%
fails in last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSkipReducerOnUpdateDmlFlagSelfTest.testDeleteWhereSubquery - 0,0%
fails in last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
H2DynamicColumnsServerCoordinatorBasicSelfTest.testComplexOperations - 0,0%
fails in last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSkipReducerOnUpdateDmlFlagSelfTest.testUpdateSetSubquery - 0,0% fails
in last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSkipReducerOnUpdateDmlFlagSelfTest.testInsertFromSelectJoin - 0,0%
fails in last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlKeyValueFieldsTest.testKeyValueAlias - 0,0% fails in last 412 master
runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSkipReducerOnUpdateDmlFlagSelfTest.testDelete - 0,0% fails in last 412
master runs.
* IgniteBinaryCacheQueryTestSuite:
H2DynamicIndexingComplexClientAtomicPartitionedTest.testOperations - 0,0% fails
in last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlNotNullConstraintTest.testNotNullCheckDmlUpdateFromSelect - 0,0% fails
in last 411 master runs.
* IgniteBinaryCacheQueryTestSuite:
H2DynamicIndexingComplexClientAtomicReplicatedTest.testOperations - 0,0% fails
in last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSkipReducerOnUpdateDmlFlagSelfTest.testInsertFromSelect - 0,0% fails
in last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSkipReducerOnUpdateDmlFlagSelfTest.testMergeFromSelectJoin - 0,0%
fails in last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
H2DynamicIndexingComplexClientTransactionalPartitionedTest.testOperations -
0,0% fails in last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSkipReducerOnUpdateDmlFlagSelfTest.testMergeFromSelectOrderBy - 0,0%
fails in last 412 master runs.
* IgniteBinaryCacheQueryTestSuite:
IgniteSqlSkipReducerOnUpdateDmlFlagSelfTest.testInsertFromSelectOrderBy - 0,0%
fails
[jira] [Commented] (IGNITE-11310) SQL: Remove special interaction between query parallelism and distributed joins
[ https://issues.apache.org/jira/browse/IGNITE-11310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767552#comment-16767552 ] Vladimir Ozerov commented on IGNITE-11310: -- Implemented. Test run: https://ci.ignite.apache.org/viewQueued.html?itemId=3079523 > SQL: Remove special interaction between query parallelism and distributed > joins > --- > > Key: IGNITE-11310 > URL: https://issues.apache.org/jira/browse/IGNITE-11310 > Project: Ignite > Issue Type: Task > Components: sql >Reporter: Vladimir Ozerov >Assignee: Vladimir Ozerov >Priority: Major > Fix For: 2.8 > > Time Spent: 0.5h > Remaining Estimate: 0h > > Currently we enable so-called "local distributed joins" when query is > executed locally with enabled parallelism. This behavior is not needed and > needs to be removed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-11310) SQL: remove special interaction between query parallelism and distributed joins
[ https://issues.apache.org/jira/browse/IGNITE-11310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767099#comment-16767099 ] Vladimir Ozerov commented on IGNITE-11310: -- A number of new failures appeared. Some of them are due to incorrect tests (e.g. missing collocation). But some of them show actual cause of "distributedJoins" flag magic. When "local" flag is set we need to query local partitions. If parallelism is enabled, then we have to query each stripe separately, and then merge the result using standard two-phase flow. For some reason "distributedJoins" flag was used to force query split and execution in two-step mode. This is wrong. What we need to do instead, is to add special flag "split needed" to parsing result. Then this flag should be used to decide how query is executed - with or without split. Previous PRs are removed since their implementation was incorrect. > SQL: remove special interaction between query parallelism and distributed > joins > --- > > Key: IGNITE-11310 > URL: https://issues.apache.org/jira/browse/IGNITE-11310 > Project: Ignite > Issue Type: Task > Components: sql >Reporter: Vladimir Ozerov >Assignee: Vladimir Ozerov >Priority: Major > Fix For: 2.8 > > Time Spent: 20m > Remaining Estimate: 0h > > Currently we enable so-called "local distributed joins" when query is > executed locally with enabled parallelism. This behavior is not needed and > needs to be removed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (IGNITE-11310) SQL: remove special interaction between query parallelism and distributed joins
[ https://issues.apache.org/jira/browse/IGNITE-11310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767048#comment-16767048 ] Vladimir Ozerov commented on IGNITE-11310: -- Implemented. Limited test run for SQL only: https://ci.ignite.apache.org/viewQueued.html?itemId=3076387 > SQL: remove special interaction between query parallelism and distributed > joins > --- > > Key: IGNITE-11310 > URL: https://issues.apache.org/jira/browse/IGNITE-11310 > Project: Ignite > Issue Type: Task > Components: sql >Reporter: Vladimir Ozerov >Assignee: Vladimir Ozerov >Priority: Major > Fix For: 2.8 > > Time Spent: 10m > Remaining Estimate: 0h > > Currently we enable so-called "local distributed joins" when query is > executed locally with enabled parallelism. This behavior is not needed and > needs to be removed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
