This is an automated email from the ASF dual-hosted git repository.
daim pushed a change to branch DetailedGC/OAK-10199
in repository https://gitbox.apache.org/repos/asf/jackrabbit-oak.git
discard e02795ed87 Merge pull request #1079 from apache/OAK-10378
discard 577aeac17f OAK-10199 : removed DetailedGC code changes for
RDBDocumentStore
discard c705535b22 OAK-10199 : made detailedGC non-configurable on
RDBDocumentStore
discard 1c70351c0f OAK-10199 : incorporated review comments to remove <p/>
XHTML tags
discard f5846e5193 OAK-10199 : renamed method name to avoid confusion with
other variable of same name
discard 6a3ddfce0c OAK-10199 : added unit cases for bundled properties getting
garbaged collected as well
discard c9abe5e5cf OAK-10199 : added bundled properties while calculating the
properties retain set as well
discard 9fc6d411ac OAK-10199 : added review comment to make minor adjustment
for naming conventions and fixes
discard e293fd6da7 OAK-10199 : refactored RDBVersionGCSupport code
discard a397f06cc2 OAK-10199 : fixed query to avoid skipping documents with
greater _modified timestamp
discard 8a8c3482e2 OAK-10199 : added logic to skip non garbage documents
discard 4ee104c9b1 OAK-10199 : added unit cases to handle concurrent prop
update and escaped properties update
discard 11794a11be OAK-10199 : handled escaped properties while deleting them
discard 5131702d32 OAK-10199 : added test case to continue with GC even if
there is crash
discard 69b52bd0fa OAK-10199 : fixed logic to include previously garbage
collected documents if updated recently
discard 644698d057 OAK-10199 : fixed the VG INIT test
discard c7a29e7358 OAK-10199 : fixed the VGC IT test cases failures for RDB
discard 12d0837e08 OAK-10199 : fixed the test case with different revision for
DetailedGC
discard f6085a9f46 OAK-10199 : added check to include oldestId when running
detailedGc very first time
discard c9c492cbde OAK-10199 : added test cases to fetch 5000+ modified docs
in loop and verify them
discard 3ae56d3c7a OAK-10199 : minor refactoring
discard 5463da0adf OAK-10199 : updated logic to fetch nodes by sorting them on
the basis of _modified & _id
discard 9930d10e7d OAK-10199 : fixed code smells as suggested by Sonar
discard 6ed1b0c1ae OAK-10199 : ignore documents which doesn't have _modified
field in mongo while fetching modifiedDocs
discard d2ed664f94 OAK-10199 : used bulk findAndModify api to perform garbage
cleanup
discard 49ebde2e8f OAK-10199 : override getModifiedDocs() for RDB and added
unit cases for deletedProps
discard 25e5b1363e OAK-10199 : provided support for feature toggle & osgi
config for detailed gc
discard 0c2f2c6bf7 OAK-10199 : disable the detailGc in tearDown to avoid
side-effects
discard 2eb2a6cebe OAK-10199 : initial sketch of detail gc skeleton
add 634cb27d07 OAK-10413: DocumentStoreIndexerIT hanging
add 0be1b75008 Merge branch 'trunk' into OAK-10413
add f4b86c806d Merge pull request #1099 from mreutegg/OAK-10413
add cccd6b68e9 OAK-10430: oak-*-azure: add to OSGi tests (#1102)
add 2d51b15ee0 OAK-10358 - Filter by path on MongoDB query when
downloading repository in Indexing job (#1042)
add f948e36cfb OAK-10371: oak-segment-azure/oak-blob-cloud-azure require
provided Guava, embed it instead (#1105)
add 6ec7926e90 OAK-10423 - Improve logging of metrics in the indexing job
(#1093)
add 13dbe7d6a7 OAK-10439: Update Oak trunk and Oak 1.22 to Jackrabbit
2.20.12 (#1109)
add 70c4eb84c5 OAK-10433 | Throttle warn logs for multivalued ordered
property (#1108)
add 95ce8d2768 Revert "OAK-10371: oak-segment-azure/oak-blob-cloud-azure
require provided Guava, embed it instead (#1105)"
add 1e55c01b22 OAK-10384: Fix stripping of large indexed ordered
properties (#1071)
new efb544bef4 OAK-10199 : initial sketch of detail gc skeleton
new 7777ab6594 OAK-10199 : disable the detailGc in tearDown to avoid
side-effects
new db888ddfcd OAK-10199 : provided support for feature toggle & osgi
config for detailed gc
new 36c3276a16 OAK-10199 : override getModifiedDocs() for RDB and added
unit cases for deletedProps
new b693841c4c OAK-10199 : used bulk findAndModify api to perform garbage
cleanup
new 0d1f5c5e46 OAK-10199 : ignore documents which doesn't have _modified
field in mongo while fetching modifiedDocs
new e9f6e3dbbe OAK-10199 : fixed code smells as suggested by Sonar
new 0a48c608ae OAK-10199 : updated logic to fetch nodes by sorting them on
the basis of _modified & _id
new ceb95b2399 OAK-10199 : minor refactoring
new 9b9b463523 OAK-10199 : added test cases to fetch 5000+ modified docs
in loop and verify them
new bab0efff90 OAK-10199 : added check to include oldestId when running
detailedGc very first time
new 9981fbde8b OAK-10199 : fixed the test case with different revision for
DetailedGC
new 94602ba4c4 OAK-10199 : fixed the VGC IT test cases failures for RDB
new 1a1a3e3b79 OAK-10199 : fixed the VG INIT test
new c36654b7d7 OAK-10199 : fixed logic to include previously garbage
collected documents if updated recently
new 92640c8c6d OAK-10199 : added test case to continue with GC even if
there is crash
new 213d80b3ee OAK-10199 : handled escaped properties while deleting them
new bebe5d26b4 OAK-10199 : added unit cases to handle concurrent prop
update and escaped properties update
new 95291ab445 OAK-10199 : added logic to skip non garbage documents
new 4dcd5cb35b OAK-10199 : fixed query to avoid skipping documents with
greater _modified timestamp
new 53c5b670ee OAK-10199 : refactored RDBVersionGCSupport code
new b4629ac44f OAK-10199 : added review comment to make minor adjustment
for naming conventions and fixes
new c59c695b06 OAK-10199 : added bundled properties while calculating the
properties retain set as well
new 9dbb46be46 OAK-10199 : added unit cases for bundled properties getting
garbaged collected as well
new a1de1bb631 OAK-10199 : renamed method name to avoid confusion with
other variable of same name
new b72cbcbcaa OAK-10199 : incorporated review comments to remove <p/>
XHTML tags
new 9e35815d71 OAK-10199 : made detailedGC non-configurable on
RDBDocumentStore
new fca431b061 OAK-10199 : removed DetailedGC code changes for
RDBDocumentStore
new 76e1ee4a5b Merge pull request #1079 from apache/OAK-10378
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (e02795ed87)
\
N -- N -- N refs/heads/DetailedGC/OAK-10199 (76e1ee4a5b)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 29 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../oak/plugins/index/FormattingUtils.java | 27 +-
.../oak/plugins/index/MetricsFormatter.java | 64 +++++
.../oak/plugins/index/importer/IndexImporter.java | 27 +-
.../oak/plugins/index/MetricsFormatterTest.java} | 25 +-
oak-it-osgi/pom.xml | 30 ++
oak-it-osgi/test-bundles.xml | 6 +
.../plugins/index/lucene/LuceneDocumentMaker.java | 62 ++++-
.../lucene/LuceneLargeStringPropertyTest.java | 116 +++++++-
oak-parent/pom.xml | 2 +-
.../indexer/document/DocumentStoreIndexerBase.java | 37 ++-
.../flatfile/FlatFileNodeStoreBuilder.java | 13 +-
.../flatfile/pipelined/PipelinedMergeSortTask.java | 31 ++-
.../pipelined/PipelinedMongoDownloadTask.java | 303 +++++++++++++++------
.../flatfile/pipelined/PipelinedSortBatchTask.java | 22 +-
.../flatfile/pipelined/PipelinedStrategy.java | 58 ++--
.../flatfile/pipelined/PipelinedTransformTask.java | 37 ++-
.../pipelined/TransformStageStatistics.java | 36 +--
.../document/flatfile/pipelined/PipelinedIT.java | 174 ++++++++++--
.../pipelined/PipelinedMongoDownloadTaskTest.java | 33 ++-
.../oak/index/ElasticDocumentStoreIndexer.java | 2 +-
.../apache/jackrabbit/oak/index/IndexCommand.java | 11 +-
.../indexer/document/DocumentStoreIndexer.java | 2 +-
.../oak/indexversion/PurgeOldIndexVersionIT.java | 2 +
.../search/spi/editor/FulltextDocumentMaker.java | 33 ++-
.../jackrabbit/oak/spi/filter/PathFilter.java | 19 +-
25 files changed, 925 insertions(+), 247 deletions(-)
copy
oak-segment-tar/src/main/java/org/apache/jackrabbit/oak/segment/spi/monitor/RemoteStoreMonitorAdapter.java
=>
oak-core/src/main/java/org/apache/jackrabbit/oak/plugins/index/FormattingUtils.java
(56%)
create mode 100644
oak-core/src/main/java/org/apache/jackrabbit/oak/plugins/index/MetricsFormatter.java
copy
oak-core/src/{main/java/org/apache/jackrabbit/oak/plugins/index/IndexUpdateCallback.java
=>
test/java/org/apache/jackrabbit/oak/plugins/index/MetricsFormatterTest.java}
(55%)
