Author: chetanm
Date: Thu Sep 15 07:14:06 2016
New Revision: 1760831
URL: http://svn.apache.org/viewvc?rev=1760831&view=rev
Log:
OAK-4412 - Lucene hybrid index
Base implementation for the hybrid index. Main parts working with some todo and
OSGi integration pending
Added:
jackrabbit/oak/tru
Author: chetanm
Date: Thu Sep 15 07:14:32 2016
New Revision: 1760833
URL: http://svn.apache.org/viewvc?rev=1760833&view=rev
Log:
OAK-4412 - Lucene hybrid index
Avoid creation of IndexDefinition instance if possible for sync indexing by
reusing the definition from tracker. This would ensure that
Author: chetanm
Date: Thu Sep 15 07:14:19 2016
New Revision: 1760832
URL: http://svn.apache.org/viewvc?rev=1760832&view=rev
Log:
OAK-4412 - Lucene hybrid index
Initialize the facet config lazily otherwise it was leading to creation of an
empty node ':facet-config' when context was created for sy
Author: chetanm
Date: Thu Sep 15 07:14:43 2016
New Revision: 1760834
URL: http://svn.apache.org/viewvc?rev=1760834&view=rev
Log:
OAK-4412 - Lucene hybrid index
Refactor to use same logic to determine if current indexing is sync or not
Modified:
jackrabbit/oak/trunk/oak-lucene/src/main/java/
Added:
jackrabbit/oak/trunk/oak-lucene/src/test/java/org/apache/jackrabbit/oak/plugins/index/lucene/hybrid/LocalIndexWriterFactoryTest.java
URL:
http://svn.apache.org/viewvc/jackrabbit/oak/trunk/oak-lucene/src/test/java/org/apache/jackrabbit/oak/plugins/index/lucene/hybrid/LocalIndexWriterFactory
Author: chetanm
Date: Thu Sep 15 07:14:55 2016
New Revision: 1760835
URL: http://svn.apache.org/viewvc?rev=1760835&view=rev
Log:
OAK-4412 - Lucene hybrid index
Use a read only builder for sync indexing case to ensure that in no case
anything gets written to NodeStore. This would cause issue with
Author: chetanm
Date: Thu Sep 15 07:15:23 2016
New Revision: 1760837
URL: http://svn.apache.org/viewvc?rev=1760837&view=rev
Log:
OAK-4412 - Lucene hybrid index
Garbage collect NRTIndex created directory on startup which may have been left
due to unclean shutdown
Modified:
jackrabbit/oak/tr
Author: chetanm
Date: Thu Sep 15 07:15:09 2016
New Revision: 1760836
URL: http://svn.apache.org/viewvc?rev=1760836&view=rev
Log:
OAK-4412 - Lucene hybrid index
Avoid costly text extraction logic for synchronous indexing mode. Binary
property would be indexed only via async indexer
Modified:
Author: chetanm
Date: Thu Sep 15 07:15:41 2016
New Revision: 1760838
URL: http://svn.apache.org/viewvc?rev=1760838&view=rev
Log:
OAK-4412 - Lucene hybrid index
Introduce ReaderRefreshPolicy to determine when the readers should be refreshed
Added:
jackrabbit/oak/trunk/oak-lucene/src/main/jav
Author: chetanm
Date: Thu Sep 15 07:16:33 2016
New Revision: 1760843
URL: http://svn.apache.org/viewvc?rev=1760843&view=rev
Log:
OAK-4412 - Lucene hybrid index
Enabled OSGi integration
Modified:
jackrabbit/oak/trunk/oak-lucene/src/main/java/org/apache/jackrabbit/oak/plugins/index/lucene/Luc
Author: chetanm
Date: Thu Sep 15 07:15:55 2016
New Revision: 1760839
URL: http://svn.apache.org/viewvc?rev=1760839&view=rev
Log:
OAK-4412 - Lucene hybrid index
Avoid adding deleted doc to the list as they get created for any deleted path
and for local indexing are anyway dropped later in Documen
Author: chetanm
Date: Thu Sep 15 07:16:43 2016
New Revision: 1760844
URL: http://svn.apache.org/viewvc?rev=1760844&view=rev
Log:
OAK-4412 - Lucene hybrid index
Add benchmark for hybrid index. The benchmark provides various options and can
work with property index and lucene indexes
Added:
Author: chetanm
Date: Thu Sep 15 07:16:21 2016
New Revision: 1760841
URL: http://svn.apache.org/viewvc?rev=1760841&view=rev
Log:
OAK-4412 - Lucene hybrid index
Builder method for async
Modified:
jackrabbit/oak/trunk/oak-lucene/src/main/java/org/apache/jackrabbit/oak/plugins/index/lucene/uti
Author: chetanm
Date: Thu Sep 15 07:16:09 2016
New Revision: 1760840
URL: http://svn.apache.org/viewvc?rev=1760840&view=rev
Log:
OAK-4412 - Lucene hybrid index
-- Enable stats collection around queue state
-- Add some extra logging in IndexNode and other parts
-- Minor change in IndexCopier to ch
Author: chetanm
Date: Thu Sep 15 07:17:01 2016
New Revision: 1760847
URL: http://svn.apache.org/viewvc?rev=1760847&view=rev
Log:
OAK-4412 - Lucene hybrid index
Enable metrics stats reporting
Modified:
jackrabbit/oak/trunk/oak-run/src/main/java/org/apache/jackrabbit/oak/benchmark/HybridIndex
Author: chetanm
Date: Thu Sep 15 07:17:31 2016
New Revision: 1760850
URL: http://svn.apache.org/viewvc?rev=1760850&view=rev
Log:
OAK-4412 - Lucene hybrid index
Perform wrote operation in batches and by grouping documents belonging to same
index. This reduces the time taken to half and reduces dr
Author: chetanm
Date: Thu Sep 15 07:17:10 2016
New Revision: 1760848
URL: http://svn.apache.org/viewvc?rev=1760848&view=rev
Log:
OAK-4412 - Lucene hybrid index
Benchmark - Handle case where exception gets thrown as Lucene related services
gets closed before shutdown in afterSuite call
Modified:
Author: chetanm
Date: Thu Sep 15 07:16:53 2016
New Revision: 1760846
URL: http://svn.apache.org/viewvc?rev=1760846&view=rev
Log:
OAK-4412 - Lucene hybrid index
Synchronize the close call to ensure concurrent close does not cause issue
Modified:
jackrabbit/oak/trunk/oak-lucene/src/main/java/
Author: chetanm
Date: Thu Sep 15 07:17:19 2016
New Revision: 1760849
URL: http://svn.apache.org/viewvc?rev=1760849&view=rev
Log:
OAK-4412 - Lucene hybrid index
Benchmarking - Add a background job to perform queries
Modified:
jackrabbit/oak/trunk/oak-run/src/main/java/org/apache/jackrabbit/o
Author: chetanm
Date: Thu Sep 15 07:17:40 2016
New Revision: 1760851
URL: http://svn.apache.org/viewvc?rev=1760851&view=rev
Log:
OAK-4412 - Lucene hybrid index
In case queue is stopped drop and further process doc call
Modified:
jackrabbit/oak/trunk/oak-lucene/src/main/java/org/apache/jackr
Author: chetanm
Date: Thu Sep 15 07:17:50 2016
New Revision: 1760852
URL: http://svn.apache.org/viewvc?rev=1760852&view=rev
Log:
OAK-4412 - Lucene hybrid index
Rename the method
Modified:
jackrabbit/oak/trunk/oak-lucene/src/main/java/org/apache/jackrabbit/oak/plugins/index/lucene/hybrid/Doc
Author: chetanm
Date: Thu Sep 15 07:17:59 2016
New Revision: 1760853
URL: http://svn.apache.org/viewvc?rev=1760853&view=rev
Log:
OAK-4412 - Lucene hybrid index
Benchmarking - Switch to breadth first child addition strategy where each
parent would have 50 child node added
Modified:
jackrabb
Author: chetanm
Date: Thu Sep 15 07:18:08 2016
New Revision: 1760854
URL: http://svn.apache.org/viewvc?rev=1760854&view=rev
Log:
OAK-4412 - Lucene hybrid index
Benchmarking - Introduce a notion of mutator which would change the indexed
property values. Also make stats provider static such that i
Author: chetanm
Date: Thu Sep 15 07:18:27 2016
New Revision: 1760856
URL: http://svn.apache.org/viewvc?rev=1760856&view=rev
Log:
OAK-4412 - Lucene hybrid index
Simple benchmark to checkout how fast local indexing can be
Modified:
jackrabbit/oak/trunk/oak-lucene/src/test/java/org/apache/jack
Author: chetanm
Date: Thu Sep 15 07:18:37 2016
New Revision: 1760857
URL: http://svn.apache.org/viewvc?rev=1760857&view=rev
Log:
OAK-4412 - Lucene hybrid index
Ignore calls which do not have any CommitContext configured
Modified:
jackrabbit/oak/trunk/oak-lucene/src/main/java/org/apache/jack
Author: chetanm
Date: Thu Sep 15 07:18:17 2016
New Revision: 1760855
URL: http://svn.apache.org/viewvc?rev=1760855&view=rev
Log:
OAK-4412 - Lucene hybrid index
Add warning log when queue is full and documents need to be dropped
Modified:
jackrabbit/oak/trunk/oak-lucene/src/main/java/org/apa
Author: chetanm
Date: Thu Sep 15 07:19:01 2016
New Revision: 1760859
URL: http://svn.apache.org/viewvc?rev=1760859&view=rev
Log:
OAK-4412 - Lucene hybrid index
Refactor to rename the method to have NRT (for near real time indexing). This
is required to distinguish it from later support for sync
Author: chetanm
Date: Thu Sep 15 07:19:17 2016
New Revision: 1760860
URL: http://svn.apache.org/viewvc?rev=1760860&view=rev
Log:
OAK-4412 - Lucene hybrid index
Preparing for supporting sync index
-- Refactored all calls which enabled sync/nrt index via direct manipulation of
builder to utility m
Author: chetanm
Date: Thu Sep 15 07:18:46 2016
New Revision: 1760858
URL: http://svn.apache.org/viewvc?rev=1760858&view=rev
Log:
OAK-4412 - Lucene hybrid index
Enable focre access to access the private field
Modified:
jackrabbit/oak/trunk/oak-lucene/src/test/java/org/apache/jackrabbit/oak/p
Author: chetanm
Date: Thu Sep 15 07:19:34 2016
New Revision: 1760861
URL: http://svn.apache.org/viewvc?rev=1760861&view=rev
Log:
OAK-4412 - Lucene hybrid index
Adding support for synchronous lucene property hybrid index
-- Introduced new enum for IndexingMode - SYNC, NRT, ASYNC
-- If the index de
Author: chetanm
Date: Thu Sep 15 07:19:50 2016
New Revision: 1760862
URL: http://svn.apache.org/viewvc?rev=1760862&view=rev
Log:
OAK-4412 - Lucene hybrid index
Synchronous indexing support continue - Simplified the refresh policy to take
in a callback which is responsible for refreshing the read
Author: chetanm
Date: Thu Sep 15 07:20:03 2016
New Revision: 1760864
URL: http://svn.apache.org/viewvc?rev=1760864&view=rev
Log:
OAK-4412 - Lucene hybrid index
Remove the LuceneDocumentHolder from commit context as to not hold memory once
docs are processed as CommitInfo may remain alive for som
Author: chetanm
Date: Thu Sep 15 07:20:25 2016
New Revision: 1760866
URL: http://svn.apache.org/viewvc?rev=1760866&view=rev
Log:
OAK-4412 - Lucene hybrid index
Switch to more deterministic distribution of indexed values
Modified:
jackrabbit/oak/trunk/oak-run/src/main/java/org/apache/jackrab
Author: chetanm
Date: Thu Sep 15 07:20:16 2016
New Revision: 1760865
URL: http://svn.apache.org/viewvc?rev=1760865&view=rev
Log:
OAK-4412 - Lucene hybrid index
Enforce a limit on max number of indexable documents held in memory to ensure
that memory consumption is bounded for large commits. For
Author: chetanm
Date: Thu Sep 15 07:20:39 2016
New Revision: 1760867
URL: http://svn.apache.org/viewvc?rev=1760867&view=rev
Log:
OAK-4412 - Lucene hybrid index
Switch to constants from IndexingConstants
Modified:
jackrabbit/oak/trunk/oak-lucene/src/main/java/org/apache/jackrabbit/oak/plugin
Author: chetanm
Date: Thu Sep 15 07:20:59 2016
New Revision: 1760868
URL: http://svn.apache.org/viewvc?rev=1760868&view=rev
Log:
OAK-4412 - Lucene hybrid index
Refactor the TimedRefreshPolicy to extra policy for sync index i.e.
RefreshOnWritePolicy which does the refresh upon write itself withou
Author: chetanm
Date: Thu Sep 15 07:21:17 2016
New Revision: 1760871
URL: http://svn.apache.org/viewvc?rev=1760871&view=rev
Log:
OAK-4412 - Lucene hybrid index
Benchmarking - Introduce flags for
-- useOakCodec - To disable compression. This speeds up the query side for
property indexes quite a b
Author: chetanm
Date: Thu Sep 15 07:21:26 2016
New Revision: 1760872
URL: http://svn.apache.org/viewvc?rev=1760872&view=rev
Log:
OAK-4412 - Lucene hybrid index
Benchmarking - Report extra stats as part of main stats
Modified:
jackrabbit/oak/trunk/oak-run/src/main/java/org/apache/jackrabbit/
Author: chetanm
Date: Thu Sep 15 07:21:08 2016
New Revision: 1760870
URL: http://svn.apache.org/viewvc?rev=1760870&view=rev
Log:
OAK-4412 - Lucene hybrid index
Change benchmark to have difference index for sync and nrt cases
Modified:
jackrabbit/oak/trunk/oak-lucene/src/test/java/org/apache
Author: chetanm
Date: Thu Sep 15 07:21:35 2016
New Revision: 1760873
URL: http://svn.apache.org/viewvc?rev=1760873&view=rev
Log:
OAK-4412 - Lucene hybrid index
Benchmarking - Remove custom management of Metrics setup and rely on one
provided by BenchmarkRunner
Modified:
jackrabbit/oak/trun
Author: chetanm
Date: Thu Sep 15 07:21:57 2016
New Revision: 1760875
URL: http://svn.apache.org/viewvc?rev=1760875&view=rev
Log:
OAK-4412 - Lucene hybrid index
Benchmarking - Bootstrap a fulltext index for both property and nrt case. This
would bring it closer to real life as there async index j
Author: chetanm
Date: Thu Sep 15 07:22:05 2016
New Revision: 1760876
URL: http://svn.apache.org/viewvc?rev=1760876&view=rev
Log:
OAK-4412 - Lucene hybrid index
Enable diagnostics
Modified:
jackrabbit/oak/trunk/oak-run/src/main/java/org/apache/jackrabbit/oak/benchmark/HybridIndexTest.java
M
Author: chetanm
Date: Thu Sep 15 07:21:48 2016
New Revision: 1760874
URL: http://svn.apache.org/viewvc?rev=1760874&view=rev
Log:
OAK-4412 - Lucene hybrid index
Refactor to move the logic around docs added to holder within holder. Going
forward this would simplify logic if we use different approa
Author: chetanm
Date: Thu Sep 15 07:22:34 2016
New Revision: 1760880
URL: http://svn.apache.org/viewvc?rev=1760880&view=rev
Log:
OAK-4412 - Lucene hybrid index
Instead of holding the reference to previous reader upon creation obtain it
every time. This is required as previous NRTIndex might rema
Author: chetanm
Date: Thu Sep 15 07:22:24 2016
New Revision: 1760879
URL: http://svn.apache.org/viewvc?rev=1760879&view=rev
Log:
OAK-4412 - Lucene hybrid index
Handle the case where IndexSearcher gets refreshed in between cursor traversal
due to change in NRT index. For such case we keep referen
Author: chetanm
Date: Thu Sep 15 07:22:14 2016
New Revision: 1760878
URL: http://svn.apache.org/viewvc?rev=1760878&view=rev
Log:
OAK-4412 - Lucene hybrid index
Benchmarking - Enable oakCodec by default so as to avoid cost of compression in
benchmark
Modified:
jackrabbit/oak/trunk/oak-run/s
Author: thomasm
Date: Thu Sep 15 09:43:59 2016
New Revision: 1760904
URL: http://svn.apache.org/viewvc?rev=1760904&view=rev
Log:
OAK-301 Document Oak - property index cost
Modified:
jackrabbit/oak/trunk/oak-doc/src/site/markdown/query/property-index.md
Modified: jackrabbit/oak/trunk/oak-doc/
Author: mduerig
Date: Thu Sep 15 10:21:46 2016
New Revision: 1760914
URL: http://svn.apache.org/viewvc?rev=1760914&view=rev
Log:
OAK-4287 Disable / remove SegmentBufferWriter#checkGCGen
Disable the check by default. It can be enabled through the
enable-generation-check feature flag
Modified:
Author: reschke
Date: Thu Sep 15 11:57:49 2016
New Revision: 1760921
URL: http://svn.apache.org/viewvc?rev=1760921&view=rev
Log:
OAK-4783: Update Oak 1.0 to Jackrabbit 2.8.3
Modified:
jackrabbit/oak/branches/1.0/oak-parent/pom.xml
Modified: jackrabbit/oak/branches/1.0/oak-parent/pom.xml
URL:
Author: mduerig
Date: Thu Sep 15 12:59:18 2016
New Revision: 1760926
URL: http://svn.apache.org/viewvc?rev=1760926&view=rev
Log:
OAK-4740: TarReader recovery skips generating the index and binary graphs
Rename BinaryReferenceConsumers to BinaryReferences
Added:
jackrabbit/oak/trunk/oak-segme
Author: mduerig
Date: Thu Sep 15 12:59:23 2016
New Revision: 1760927
URL: http://svn.apache.org/viewvc?rev=1760927&view=rev
Log:
OAK-4740: TarReader recovery skips generating the index and binary graphs
Represent non inlined binary references by the record id of the string record
in the binary in
Author: mreutegg
Date: Thu Sep 15 13:24:39 2016
New Revision: 1760930
URL: http://svn.apache.org/viewvc?rev=1760930&view=rev
Log:
OAK-4174: SegmentToJdbcTest failing with improvements of OAK-4119
Merged revision 1738234 from trunk
Modified:
jackrabbit/oak/branches/1.4/ (props changed)
Modified:
jackrabbit/oak/trunk/oak-segment-tar/src/main/java/org/apache/jackrabbit/oak/segment/standby/server/DefaultStandbySegmentReader.java
URL:
http://svn.apache.org/viewvc/jackrabbit/oak/trunk/oak-segment-tar/src/main/java/org/apache/jackrabbit/oak/segment/standby/server/DefaultStandbySegmen
Author: frm
Date: Thu Sep 15 14:03:05 2016
New Revision: 1760934
URL: http://svn.apache.org/viewvc?rev=1760934&view=rev
Log:
OAK-4803 - Simplify the client side of the cold standby
Added:
jackrabbit/oak/trunk/oak-segment-tar/src/main/java/org/apache/jackrabbit/oak/segment/standby/client/GetB
Author: reschke
Date: Thu Sep 15 15:05:41 2016
New Revision: 1760946
URL: http://svn.apache.org/viewvc?rev=1760946&view=rev
Log:
OAK-4793: RDBDocumentStore: make sure cache is invalidated upon JDBC exceptions
Added:
jackrabbit/oak/trunk/oak-core/src/test/java/org/apache/jackrabbit/oak/plugin
Author: mduerig
Date: Thu Sep 15 16:19:26 2016
New Revision: 1760956
URL: http://svn.apache.org/viewvc?rev=1760956&view=rev
Log:
[maven-release-plugin] copy for tag oak-segment-tar-0.0.12
Added:
jackrabbit/oak/tags/oak-segment-tar-0.0.12/ (props changed)
- copied from r1760955, jackr
Author: mduerig
Date: Thu Sep 15 16:19:28 2016
New Revision: 1760957
URL: http://svn.apache.org/viewvc?rev=1760957&view=rev
Log:
[maven-release-plugin] prepare for next development iteration
Modified:
jackrabbit/oak/trunk/oak-segment-tar/pom.xml
Modified: jackrabbit/oak/trunk/oak-segment-tar
Author: mduerig
Date: Thu Sep 15 16:19:23 2016
New Revision: 1760955
URL: http://svn.apache.org/viewvc?rev=1760955&view=rev
Log:
[maven-release-plugin] prepare release oak-segment-tar-0.0.12
Modified:
jackrabbit/oak/trunk/oak-segment-tar/pom.xml
Modified: jackrabbit/oak/trunk/oak-segment-tar
58 matches
Mail list logo
