GitHub user GERey opened a pull request:
https://github.com/apache/usergrid/pull/437
Read repair for index values
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/usergrid readRepairForIndexValues
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/usergrid/pull/437.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #437
----
commit a72da10f85bd01b47950e18b4ab2f47dfa4ecf23
Author: George Reyes <[email protected]>
Date: 2015-10-28T18:23:37Z
Added the collection tool that needs to be expanded
commit b44e537d5ceca642ffc3049f982e1fa41ceb374c
Author: George Reyes <[email protected]>
Date: 2015-11-02T16:42:05Z
Added fix where when not returning all entities would prematurely exit the
program
commit a40cf28430e7b480502180ea9f0a13908def4175
Author: George Reyes <[email protected]>
Date: 2015-11-02T17:33:36Z
Changed logic to use paging results iterator. Should be equivalent to
previous iterators but easier to understand.
commit 0b3eea1793405a089857d3c14cc898b6a83cd41a
Author: George Reyes <[email protected]>
Date: 2015-11-02T17:38:32Z
Removed commented out older code.
commit a4205230cc342398e184fa87470bda93ee7fe996
Author: George Reyes <[email protected]>
Date: 2015-11-02T17:54:43Z
Finished refactor and verified locally.
commit a4a7884b8c9f1b4f996dc3b51124c72eee3e9afa
Author: George Reyes <[email protected]>
Date: 2015-11-02T22:57:06Z
Added entity unique to unique index cleanup.
commit 5dabe6e07159a684d6e5c6f5dd57353b3d2e79fe
Author: George Reyes <[email protected]>
Date: 2015-11-02T23:30:10Z
initial steps towards a fix where we only iterate through the entity_unique
column family.
commit ac7e30a871ebb3701bc3d62f3b5923f9e0e3e332
Author: George Reyes <[email protected]>
Date: 2015-11-03T23:56:44Z
Committing smoke test to step through the new unique index cleanup
commit bd1acf578faa7747380dcb1f3d5b2dd564d74008
Author: George Reyes <[email protected]>
Date: 2015-11-04T23:41:46Z
Created initial version that actually iterates through entity unique column
and finds uuid's to corresponding entities.
commit 94826997754300b034754860424e5987a9f2ab7e
Author: George Reyes <[email protected]>
Date: 2015-11-05T00:01:57Z
Cleaned up code that was left over from dev process.
commit 03a123dc830908f0f1eb46504d39d0050c8887c5
Author: George Reyes <[email protected]>
Date: 2015-11-05T00:11:46Z
RC1 for unique index cleanup tool
commit 6e8b2b621cc45636bb322b03d0670d5d01b0a97d
Author: George Reyes <[email protected]>
Date: 2015-11-05T00:34:48Z
Removing code that has been refactored out. Edited flow to lead up to range
query with more readability.
commit 6d96a4c90abae8768e9fbd41001a5cc66bbe8949
Author: George Reyes <[email protected]>
Date: 2015-11-05T00:37:30Z
Fixed test and removed options that weren't being used.
commit 48a8006d41c23abbdae23b20c851e76f7f53d3f2
Author: George Reyes <[email protected]>
Date: 2015-11-05T19:04:57Z
Added a workaround for buffers starting with garbage data instead of the
application uuid. Now it filters out the beginning of the buffer.
commit dde3ea668cd9608b2614002b66c1a0469fae71ae
Author: George Reyes <[email protected]>
Date: 2015-11-05T19:38:24Z
Added ability to delete rows that contained 0 columns.
commit 99af194bbd336bea71db42def275fe507d663e31
Author: George Reyes <[email protected]>
Date: 2015-11-05T20:27:39Z
Added ability to verify individual entities and try to delete them. This
functionality doesn't exist for columns with nothing in them.
commit 267ea394021f027306e7821e8ef3f938f2bd44a0
Author: George Reyes <[email protected]>
Date: 2015-11-06T15:37:11Z
Created test for exact issue. Will try repair on that
commit 80ad870caad0f3ba8e446925c61cc5b374211108
Author: George Reyes <[email protected]>
Date: 2015-11-06T22:11:29Z
Added additional tests to verify that proper values won't get deleted.
commit 14eec4f229c988704753083a543bf2dd378d615d
Author: George Reyes <[email protected]>
Date: 2015-11-06T22:22:03Z
Added additional test to verify that we can delete and fix single values
commit 0ba197e434ca6cc146c8c36e53f692bed124b868
Author: George Reyes <[email protected]>
Date: 2015-11-09T23:10:13Z
Added tests and fixed bug where the tool could not handle non standard row
keys from older versions of usergrid.
commit 7db57696f70859c73cde5c32773e0339f17790bf
Author: George Reyes <[email protected]>
Date: 2015-11-10T17:05:21Z
Added message that indicates it has completed
commit a67057909e480c97273c9f6c366643069f24e114
Author: George Reyes <[email protected]>
Date: 2015-11-10T17:06:15Z
Added tests and read repair to the guts of 1.0
commit 2e8bc46329b11d5e625d75aad1b3dbb1d39e91ee
Author: George Reyes <[email protected]>
Date: 2015-11-10T20:22:41Z
Added ignore to test for use case that doesn't currently work.
Added ability to filter out multiple entities with the same user name (
pick the one one modified last )
commit 1fab1db945da08e4bd989aa44799133428cada5f
Author: George Reyes <[email protected]>
Date: 2015-11-10T22:15:30Z
Added prints for values that end up getting cleaned.
commit 00171f07b12a6779f015931d718e30bdf738f11f
Author: George Reyes <[email protected]>
Date: 2015-11-10T22:15:51Z
Merge branch 'USERGRID-1076' of
https://git-wip-us.apache.org/repos/asf/usergrid into readRepairForIndexValues
* 'USERGRID-1076' of https://git-wip-us.apache.org/repos/asf/usergrid:
Added prints for values that end up getting cleaned.
Added ignore to test for use case that doesn't currently work. Added
ability to filter out multiple entities with the same user name ( pick the one
one modified last )
commit 3d5ae464766a12b3fac1d82b67da667ef28d17fd
Author: George Reyes <[email protected]>
Date: 2015-11-10T22:49:40Z
Added fix for rows that contain duplicate valid existing columns.
commit b38f5bcb48dd2603a0b095d2c651ba2575a006f1
Author: George Reyes <[email protected]>
Date: 2015-11-11T00:00:08Z
Added cleanup for false unique property cleanup if there were no
corresponding entities
Added test for 1000 such entities and verifying that they were indeed fixed
correctly.
commit 6acc8d3b5eddbe5a449dee70fe910f8098cf5baf
Author: George Reyes <[email protected]>
Date: 2015-11-11T22:42:48Z
Added in extra logic to handle legacy entities and re added in the single
case repair.
commit 80ffb35481740cde38b17d82cec699ac8992d009
Author: George Reyes <[email protected]>
Date: 2015-11-11T22:50:12Z
Removed some comments.
commit 1d89dbb69fb260f450aa5ac3f43e70c8a095ed85
Author: George Reyes <[email protected]>
Date: 2015-11-12T17:31:50Z
Added some fixes to read repair.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
