[
https://issues.apache.org/jira/browse/USERGRID-405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350492#comment-14350492
]
ASF GitHub Bot commented on USERGRID-405:
-----------------------------------------
GitHub user tnine opened a pull request:
https://github.com/apache/incubator-usergrid/pull/175
quite ready Usergrid 405
Merge of USERGRID-405, USERGRID-427, andUSERGRID-381.
Address most of USERGRID-365.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/incubator-usergrid USERGRID-405
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-usergrid/pull/175.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #175
----
commit ee676e78ad8f1905a169a027eb97aa7b1dc7aa7a
Author: Shawn Feldman <[email protected]>
Date: 2015-01-29T18:46:01Z
added new entity object for serialization
add new guide interface names
fix compile issues in core persistence
add array field instead of list field
adding proxies to new storage
spacing changes
fixed id problems
remove excess fields
Test are passing
pushing migrations into core persistence
pushing migrations into core persistence
moving dependencies to core persistence
moving dependencies to core persistence
moving dependencies to core persistence
add DataMigrationManagers
Rename Serialization Strategy Proxy
tests passing in core persistence
Refactor Application Entity Group
fixed null issue with index
remove observable
commit fa82c6dc00cbfa58d7f12e56bdc757bdc4ae4b0c
Author: Shawn Feldman <[email protected]>
Date: 2015-02-11T17:51:29Z
add logic to continue alias buildout despite issues removing
commit 29f24a9716086da70d11f3b5d9839280c5ffc650
Author: Todd Nine <[email protected]>
Date: 2015-02-11T21:18:07Z
Fixed index alias cache invalidation
commit 4781c4088e282ae1671d590f75fb3546fb8ab944
Author: Shawn Feldman <[email protected]>
Date: 2015-02-12T00:16:03Z
adding condition; not sure this is correct
commit 2f8993af9d1bcdd09153880b3fe317ed4149d899
Author: Shawn Feldman <[email protected]>
Date: 2015-02-12T20:15:14Z
fix tests
commit d439036089ec547648338429e8146073fbf70af0
Author: Shawn Feldman <[email protected]>
Date: 2015-02-12T21:01:35Z
change logging
commit 07f6cfedac9d5394c69c6c62355f6830bb37d2f2
Author: Shawn Feldman <[email protected]>
Date: 2015-02-12T21:02:31Z
remove connections
commit ba189eaf933a6209810f1e72dde80bfe972f288b
Author: Shawn Feldman <[email protected]>
Date: 2015-02-12T22:27:55Z
merged
commit 35b95fd14d1792eb6a51dd9f4a3373d241469fc6
Author: Shawn Feldman <[email protected]>
Date: 2015-02-13T16:26:26Z
fix test
commit f1b0c8d864042ccc0481550ae3a48f4fb5da874e
Author: Shawn Feldman <[email protected]>
Date: 2015-02-13T18:32:01Z
adding generic to prevent casting at low levels
commit 4657c8df7f150f108dfc77af66efd54c034042d3
Author: Shawn Feldman <[email protected]>
Date: 2015-02-13T22:04:46Z
reimplemented filtering for migrations
commit db2585ec2671c4722b97adb88afdc55b54b120cd
Author: Shawn Feldman <[email protected]>
Date: 2015-02-13T22:28:01Z
cp tests passing
commit e5224695202fd5533ea027964f7fc0e515f50678
Author: Shawn Feldman <[email protected]>
Date: 2015-02-13T23:04:59Z
tests passing again
commit 79ec9787c185b3e1a43aba5f456b5568b5735235
Author: Shawn Feldman <[email protected]>
Date: 2015-02-16T18:07:55Z
adding specific migration types
commit dab3ee0f39ca5214c04647953a0783f4fdd692ba
Author: Shawn Feldman <[email protected]>
Date: 2015-02-16T18:18:04Z
test fix
commit eace1cdc4396fe80d3da55639ce4e6932132175c
Author: Shawn Feldman <[email protected]>
Date: 2015-02-16T18:18:23Z
Merge branch 'USERGRID-273' of
https://git-wip-us.apache.org/repos/asf/incubator-usergrid into USERGRID-365
commit ed20408b7bfce4d0006c0e084adca0a7e97da34e
Author: Shawn Feldman <[email protected]>
Date: 2015-02-16T18:47:01Z
Move migrations to common interface
commit 59777e5952c31f570273ddc94e5e569bdefad468
Author: Shawn Feldman <[email protected]>
Date: 2015-02-16T20:31:44Z
add routing mapping
commit 90950908019f131f5874f635af7ece235bea2ce1
Author: Shawn Feldman <[email protected]>
Date: 2015-02-16T21:57:32Z
merge 365-273
commit 4e143574640e7ec7bb7e288191f24e816862c9d9
Author: Shawn Feldman <[email protected]>
Date: 2015-02-16T21:58:01Z
Merge branch 'USERGRID-273' of
https://git-wip-us.apache.org/repos/asf/incubator-usergrid into USERGRID-365
commit 748636873e7ba480949294e5a4b3fb1f7dafdc2c
Author: Shawn Feldman <[email protected]>
Date: 2015-02-16T22:41:26Z
remove writestart when there is no version
commit 904c5ddff43813b7eb9a273c46b11346853207db
Author: Shawn Feldman <[email protected]>
Date: 2015-02-16T22:46:19Z
add validation for index resource
commit a029041fad4935c41855cab861719da2c1fa7e2f
Author: Shawn Feldman <[email protected]>
Date: 2015-02-17T00:27:31Z
merge 276
commit d2371f99b4b64dda52e9ff7991e0f6144859779e
Author: Todd Nine <[email protected]>
Date: 2015-02-19T23:04:26Z
First pass at refactor and re-implementation for new serialization
commit 067e78e303cd35c2c0062221f58fa130ae079455
Author: Todd Nine <[email protected]>
Date: 2015-02-19T23:35:32Z
Removed unused synchronous interface
Removed entity repair, no longe relevant
Unique value serialization needs re-work.
commit ffa30962d32023f73ee2253038259af3fa7af2d7
Author: Todd Nine <[email protected]>
Date: 2015-02-20T02:49:22Z
WIP overwrite
commit 8c581a48d48fba5cd76dd018a40288cf300164ea
Author: Todd Nine <[email protected]>
Date: 2015-02-24T00:18:18Z
Fixed timestamp on write. Also fixed tests. Left unsupported interface
values to support migration. We should remove in a +1 release.
commit c2989fc702eeb240956e981de637dca68426a68b
Author: Todd Nine <[email protected]>
Date: 2015-02-24T04:04:09Z
Renamed unique serializers to be easier to locate
Added serializer to create row format necessary for unique ledger
commit 9f65a973b0b19d8650bf96ee6b245752d9e3c544
Author: Todd Nine <[email protected]>
Date: 2015-02-24T22:31:25Z
Updated tasks and interface for getting unique values
commit 49fa8123d09b8afe8ff3496a1ce7019d26e9eacf
Author: Todd Nine <[email protected]>
Date: 2015-02-25T01:17:43Z
Adds test and verifies api works as expected
----
> Fix hotspot from continuous writes of entities (Shawn)
> ------------------------------------------------------
>
> Key: USERGRID-405
> URL: https://issues.apache.org/jira/browse/USERGRID-405
> Project: Usergrid
> Issue Type: Story
> Reporter: Todd Nine
> Assignee: Todd Nine
>
> Currently, performing a continuous PUT in 2.0 under heavy load causes a
> hotspot in our cassandra data.
> Cause:
> # Under load, entities can be PUT continuously
> # Asynchronous cleanups run and delete previous versions
> # These versions are retained in cassandra for long periods of time. This
> causes severe row bloating before compaction occurs.
> Solution:
> For entity data, we only care about the current max version. We should
> change this column family to store only the maximum data format. We will
> need to keep the log of previous versions, so that we can bring ES into a
> consistent state
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
