GitHub user cramja opened a pull request:
https://github.com/apache/incubator-quickstep/pull/129
Partial inserts
This change enables use of the PartialBulkInserts feature, an efficient
implementation of which was introduced in the SplitRowStore in #100 . Most of
these changes were imported from @navsan 's branch which exploited partial
inserts but only implemented the storage optimization required to take
advantage of them for the PackedRowStore.
*Performance*
We ran SSB100 on the cloudlab machines and found that SplitRow's
performance was almost exactly the same as PackedRow. `packed+split opt`
includes both packed and splitrow with the copy optimization and uses both
splitrow and packed row intermediate blocks. `splitrow opt ` uses only
optimized splitrowstore blocks for intermediates.
```
time (s)
12.579 12.175 12.114
no opt splitrow opt packed+split opt
```
*TODO*
In a later PR (after paper submission), we will remove packed rowstore as
it represents unnecessary complexity.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/cramja/incubator-quickstep partial-inserts
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-quickstep/pull/129.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #129
----
commit 57144fd898ebec3e28d8b889b89254bafdfdf895
Author: navsan <nav...@gmail.com>
Date: 2016-11-07T20:35:01Z
Adds support for PartialBulkInserts in StorageBlocks
- Enables use of PartialBulkInserts in StorageBlocks
- Value accessor changes to allow use of 2 insert destinations
- HashJoin now uses PartialBulkInserts
commit 6c63c03cdc9cac42ff35ca804c1622dace049a81
Author: cramja <marc.spehlm...@gmail.com>
Date: 2016-11-07T22:00:31Z
Enables PartialInserts for SplitRow + Only use SplitRow Intermediates
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
