[jira] [Commented] (OAK-8926) add RDBBlobStore performance test
[ https://issues.apache.org/jira/browse/OAK-8926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653567#comment-17653567 ] Julian Reschke commented on OAK-8926: - trunk: (1.26.0) [e2d095fb5b|https://github.com/apache/jackrabbit-oak/commit/e2d095fb5b82c8125b175fef698cac5e4a509eb1] [2fdc431595|https://github.com/apache/jackrabbit-oak/commit/2fdc431595c77bb3f8d4492301ec9fade9bb0468] [f045f9c8c9|https://github.com/apache/jackrabbit-oak/commit/f045f9c8c972db088c30e66b3b431e4ff33d50c8] [1d71a6c00c|https://github.com/apache/jackrabbit-oak/commit/1d71a6c00c0d4c1df32a6ca5ffc8bc651947d34a] > add RDBBlobStore performance test > - > > Key: OAK-8926 > URL: https://issues.apache.org/jira/browse/OAK-8926 > Project: Jackrabbit Oak > Issue Type: Technical task > Components: rdbmk >Reporter: Julian Reschke >Assignee: Julian Reschke >Priority: Minor > Labels: candidate_oak_1_22 > Fix For: 1.26.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (OAK-8926) add RDBBlobStore performance test
[ https://issues.apache.org/jira/browse/OAK-8926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070776#comment-17070776 ] Solomon Rutzky commented on OAK-8926: - [~reschke] Please see: OAK-8977 > add RDBBlobStore performance test > - > > Key: OAK-8926 > URL: https://issues.apache.org/jira/browse/OAK-8926 > Project: Jackrabbit Oak > Issue Type: Technical task > Components: rdbmk >Reporter: Julian Reschke >Assignee: Julian Reschke >Priority: Minor > Labels: candidate_oak_1_22 > Fix For: 1.26.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (OAK-8926) add RDBBlobStore performance test
[ https://issues.apache.org/jira/browse/OAK-8926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17065365#comment-17065365 ] Julian Reschke commented on OAK-8926: - The code just uses a datasource. The tests use the Tomcat JDBC pool datasource config. > add RDBBlobStore performance test > - > > Key: OAK-8926 > URL: https://issues.apache.org/jira/browse/OAK-8926 > Project: Jackrabbit Oak > Issue Type: Technical task > Components: rdbmk >Reporter: Julian Reschke >Assignee: Julian Reschke >Priority: Minor > Labels: candidate_oak_1_22 > Fix For: 1.26.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (OAK-8926) add RDBBlobStore performance test
[ https://issues.apache.org/jira/browse/OAK-8926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17065360#comment-17065360 ] Solomon Rutzky commented on OAK-8926: - Well, it was certainly worth a try, so thanks for testing that. One other question: is JDBC configured to use connection pooling? I checked the documentation but it wasn't clear as to whether or not connection pooling was enabled by default. If it's not being used, then it certainly needs to be enabled. > add RDBBlobStore performance test > - > > Key: OAK-8926 > URL: https://issues.apache.org/jira/browse/OAK-8926 > Project: Jackrabbit Oak > Issue Type: Technical task > Components: rdbmk >Reporter: Julian Reschke >Assignee: Julian Reschke >Priority: Minor > Labels: candidate_oak_1_22 > Fix For: 1.26.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (OAK-8926) add RDBBlobStore performance test
[ https://issues.apache.org/jira/browse/OAK-8926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17065056#comment-17065056 ] Julian Reschke commented on OAK-8926: - Interesting suggestion. I have tried this, but couldn't yet see noticable differences. Might have to tune the benchmark somewhat more. > add RDBBlobStore performance test > - > > Key: OAK-8926 > URL: https://issues.apache.org/jira/browse/OAK-8926 > Project: Jackrabbit Oak > Issue Type: Technical task > Components: rdbmk >Reporter: Julian Reschke >Assignee: Julian Reschke >Priority: Minor > Labels: candidate_oak_1_22 > Fix For: 1.26.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (OAK-8926) add RDBBlobStore performance test
[
https://issues.apache.org/jira/browse/OAK-8926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064551#comment-17064551
]
Solomon Rutzky commented on OAK-8926:
-
{quote}...all information is there, if you want to try...
{quote}
Yes, I do understand that I _could_ test this on my own, and usually I do.
However, I really don't even have time for what I've been doing so far for this
project – reviewing the changes, reading through various issues, and
commenting. So, getting the environment set up on my system is, unfortunately,
time I just don't have. I will, however, recommend experimenting with a
_non_-clustered PK. With no clustered index, the table remains a "heap". This
is not a pattern that I would typically use, but in this case it might work. I
made some minor edits to the T-SQL you posted in OAK-8908 (
{{Latin1_General_CI_AS}} into {{Latin1_General_BIN2}}, and {{CLUSTERED}} into
{{NONCLUSTERED}} ). When you get a chance, try that to see if it helps.
{code:sql}
USE [DBNAME];
ALTER TABLE [DATASTORE_DATA] DROP CONSTRAINT [DATA_PK];
ALTER TABLE [DATASTORE_DATA] ALTER COLUMN [ID] VARCHAR(64) COLLATE
Latin1_General_BIN2 NOT NULL;
ALTER TABLE [DATASTORE_DATA] ADD CONSTRAINT [DATA_PK] PRIMARY KEY NONCLUSTERED
([ID] ASC);
ALTER TABLE [DATASTORE_META] DROP CONSTRAINT [META_PK];
ALTER TABLE [DATASTORE_META] ALTER COLUMN [ID] VARCHAR(64) COLLATE
Latin1_General_BIN2 NOT NULL;
ALTER TABLE [DATASTORE_META] ADD CONSTRAINT [META_PK] PRIMARY KEY NONCLUSTERED
([ID] ASC);
{code}
> add RDBBlobStore performance test
> -
>
> Key: OAK-8926
> URL: https://issues.apache.org/jira/browse/OAK-8926
> Project: Jackrabbit Oak
> Issue Type: Technical task
> Components: rdbmk
>Reporter: Julian Reschke
>Assignee: Julian Reschke
>Priority: Minor
> Labels: candidate_oak_1_22
> Fix For: 1.26.0
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (OAK-8926) add RDBBlobStore performance test
[ https://issues.apache.org/jira/browse/OAK-8926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063815#comment-17063815 ] Julian Reschke commented on OAK-8926: - ...all information is there, if you want to try... bq. A more likely reason for the SQL Server performance is that the clustered index (the physical ordering of the table) is the ID column, and the ID values are non-sequential. Yes, that's the case. > add RDBBlobStore performance test > - > > Key: OAK-8926 > URL: https://issues.apache.org/jira/browse/OAK-8926 > Project: Jackrabbit Oak > Issue Type: Technical task > Components: rdbmk >Reporter: Julian Reschke >Assignee: Julian Reschke >Priority: Minor > Labels: candidate_oak_1_22 > Fix For: 1.26.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (OAK-8926) add RDBBlobStore performance test
[
https://issues.apache.org/jira/browse/OAK-8926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063746#comment-17063746
]
Solomon Rutzky commented on OAK-8926:
-
I'm not sure that "primary keys" is the correct term to use in the comment
directly above. I can't say much about the MySQL results, but for SQL Server I
would need to see the configuration of the DB and maybe some other stuff to
better determine the issue. A more likely reason for the SQL Server performance
is that the clustered index (the physical ordering of the table) is the {{ID}}
column, _and_ the {{ID}} values are non-sequential.
> add RDBBlobStore performance test
> -
>
> Key: OAK-8926
> URL: https://issues.apache.org/jira/browse/OAK-8926
> Project: Jackrabbit Oak
> Issue Type: Technical task
> Components: rdbmk
>Reporter: Julian Reschke
>Assignee: Julian Reschke
>Priority: Minor
> Labels: candidate_oak_1_22
> Fix For: 1.26.0
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (OAK-8926) add RDBBlobStore performance test
[
https://issues.apache.org/jira/browse/OAK-8926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051075#comment-17051075
]
Julian Reschke commented on OAK-8926:
-
Example output (in unit test log):
{noformat}
inserted 2126 blocks of size 1500 into RDB-DB2 (0 errors) in 2000ms (1063
blocks/s)
inserted 11348 blocks of size 1500 into RDB-H2(file) (0 errors) in 2000ms (5674
blocks/s)
inserted 4396 blocks of size 1500 into RDB-Derby(embedded) (0 errors) in 2000ms
(2198 blocks/s)
inserted 323 blocks of size 1500 into RDB-MSSql (0 errors) in 2000ms (161
blocks/s)
inserted 153 blocks of size 1500 into RDB-MySQL (0 errors) in 2000ms (76
blocks/s)
inserted 1729 blocks of size 1500 into RDB-Oracle (0 errors) in 2000ms (864
blocks/s)
inserted 1954 blocks of size 1500 into RDB-Postgres (0 errors) in 2000ms (977
blocks/s)
{noformat}
So SQL Server and MySQL stand out. This might be because they do not handle
"large" character primary keys well.
> add RDBBlobStore performance test
> -
>
> Key: OAK-8926
> URL: https://issues.apache.org/jira/browse/OAK-8926
> Project: Jackrabbit Oak
> Issue Type: Technical task
> Components: rdbmk
>Reporter: Julian Reschke
>Assignee: Julian Reschke
>Priority: Minor
> Labels: candidate_oak_1_22
> Fix For: 1.26.0
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (OAK-8926) add RDBBlobStore performance test
[ https://issues.apache.org/jira/browse/OAK-8926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046179#comment-17046179 ] Julian Reschke commented on OAK-8926: - trunk: [r1874555|http://svn.apache.org/r1874555] > add RDBBlobStore performance test > - > > Key: OAK-8926 > URL: https://issues.apache.org/jira/browse/OAK-8926 > Project: Jackrabbit Oak > Issue Type: Technical task > Components: rdbmk >Reporter: Julian Reschke >Assignee: Julian Reschke >Priority: Minor > Labels: candidate_oak_1_22 > Fix For: 1.26.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
