Kelson has submitted this change and it was merged.
Change subject: Fixed compilation on OSX. made a script to compile both static
and shared
..
Fixed compilation on OSX. made a script to compile both static and shared
Change-
Kelson has submitted this change and it was merged.
Change subject: Fixed wrong libmagic path
..
Fixed wrong libmagic path
Change-Id: Ic7674a62530abde447252fd6c0b693a8d741443e
---
M zimwriterfs/macosx-build.sh
1 file changed, 1
Kelson has uploaded a new change for review.
https://gerrit.wikimedia.org/r/117699
Change subject: Fix mobile/desktop view choices substainability on 3 parts
domain names (like wikimedia.org.uk) #54885
..
Fix mobile/desktop v
Kelson has submitted this change and it was merged.
Change subject: Add .gitignore and .gitreview
..
Add .gitignore and .gitreview
Bug: 54175
Change-Id: Ic900b6a1aa3848aa59b428adef19115a9c55ac61
---
A .gitignore
A .gitreview
2
Kelson has submitted this change and it was merged.
Change subject: Invalidate internal streambuf buffer when we change it.
..
Invalidate internal streambuf buffer when we change it.
It may be not necessary as it never fails be
Kelson has submitted this change and it was merged.
Change subject: Always try to cache a cluster, even if it is a uncompressed one.
..
Always try to cache a cluster, even if it is a uncompressed one.
Creating a cluster is cost
Kelson has submitted this change and it was merged.
Change subject: Avoid get the dirent too many time.
..
Avoid get the dirent too many time.
Article::is* functions are "alias" to Article::getDirent().is* functions.
As we alre
Kelson has submitted this change and it was merged.
Change subject: Read the cluster content only when necessary.
..
Read the cluster content only when necessary.
Instead of reading the full cluster content at cluster creation,
Kelson has submitted this change and it was merged.
Change subject: Remove unused currentPos from fstream.
..
Remove unused currentPos from fstream.
Change-Id: Idd7e392b35dbe36e5d4ee4a03f6119bb01ab4e2e
---
M zimlib/include/zim/
Kelson has submitted this change and it was merged.
Change subject: Adapt tests to new internal cluster API.
..
Adapt tests to new internal cluster API.
- There is no more operator>>() on cluster. We should use init_from_stream
Kelson has submitted this change and it was merged.
Change subject: Do not cache uncompressed cluster by default.
..
Do not cache uncompressed cluster by default.
Uncompressed cluster can be big (if they contain videos for exam
Kelson has submitted this change and it was merged.
Change subject: [zimwriterfs] Try to avoid too big cluster.
..
[zimwriterfs] Try to avoid too big cluster.
We check that cluster will not be too big *before* adding the conten
Kelson has submitted this change and it was merged.
Change subject: Fix memory corruption in decodeUrl.
..
Fix memory corruption in decodeUrl.
Reuse the function from kiwix as it does the same thing but with much
better c++ cod
Kelson has submitted this change and it was merged.
Change subject: Fix memory leak in zimwriterfs.
..
Fix memory leak in zimwriterfs.
We are using polymorphism in articlesource.cpp (a Article* pointer but
derived class as real
Kelson has submitted this change and it was merged.
Change subject: Delete all articles, even the last one.
..
Delete all articles, even the last one.
No so important, only one article *could* be impacted.
(If it is the last ar
Kelson has submitted this change and it was merged.
Change subject: Close the magic database.
..
Close the magic database.
Change-Id: Ib0c7d1736d804526eea701ef39cb9ae5780b13c1
---
M zimwriterfs/zimwriterfs.cpp
1 file changed, 2
Kelson has submitted this change and it was merged.
Change subject: Better replaceStringInPlaceOnce.
..
Better replaceStringInPlaceOnce.
If we do only one replace, we do not need a while and a update of pos.
(Thank to cppcheck)
Kelson has submitted this change and it was merged.
Change subject: The indexed url must contain the namespace.
..
The indexed url must contain the namespace.
Change-Id: Icc17c7552a2b213a15edc2c674fe00aacb36952b
---
M zimwriter
Kelson has submitted this change and it was merged.
Change subject: Remove temporary ft_index.
..
Remove temporary ft_index.
Xapian indexer create temporary files while indexing content.
Remove those files at end.
Change-Id: I
Kelson has uploaded a new change for review.
https://gerrit.wikimedia.org/r/273774
Change subject: Fix regex to enable upload from ETHZ Library with the GWT
..
Fix regex to enable upload from ETHZ Library with the GWT
Change-
Kelson has uploaded a new change for review.
https://gerrit.wikimedia.org/r/200313
Change subject: Allow to backup globalimagelinks table, T87571
..
Allow to backup globalimagelinks table, T87571
Change-Id: I17c40250c39f20c89
Kelson has submitted this change and it was merged.
Change subject: Bug fix: don't store pointers inside a dynamic vector.
..
Bug fix: don't store pointers inside a dynamic vector.
Use offsets instead, since the actual objects
Kelson has submitted this change and it was merged.
Change subject: Actually call the (previously-unused) ArticleSource#setFilename
method.
..
Actually call the (previously-unused) ArticleSource#setFilename method.
Change-Id:
Kelson has submitted this change and it was merged.
Change subject: Explain that ZIntStream only represents uint32_t values right
now.
..
Explain that ZIntStream only represents uint32_t values right now.
Change-Id: Id71284794
Kelson has submitted this change and it was merged.
Change subject: Revert "Use explicit LZMA_STREAM_INIT initializer, instead of
memset."
..
Revert "Use explicit LZMA_STREAM_INIT initializer, instead of memset."
This reverts
Kelson has submitted this change and it was merged.
Change subject: Add a indexer.
..
Add a indexer.
This indexer is not used.
This is mainly code from kiwix-indexer imported in openzim.
Unused function in *Tools has been remov
Kelson has submitted this change and it was merged.
Change subject: Port zimwriterfs to the new API.
..
Port zimwriterfs to the new API.
No more ArticleSource::getData.
Change-Id: I76cd6f3e7e4a390ed6a58cf9815dda2a2f1bfde5
---
Kelson has submitted this change and it was merged.
Change subject: Handle the case of last article for filenameQueue is invalid.
..
Handle the case of last article for filenameQueue is invalid.
Change-Id: I970d7dc6cfbc572ed7c2
Kelson has submitted this change and it was merged.
Change subject: Add xapian indexer.
..
Add xapian indexer.
Xapian is optional.
Build your index inside zim by adding "-i" or "--createFullTextIndex"
to zimwriterfs' command li
Kelson has submitted this change and it was merged.
Change subject: Revert compatibility with previous API.
..
Revert compatibility with previous API.
The API has changed. The behavior is different, so do not try to keep
a fals
Kelson has submitted this change and it was merged.
Change subject: Add a API to get the offset of a article in the zimfile.
..
Add a API to get the offset of a article in the zimfile.
To get the offset of a article :
- get th
Kelson has submitted this change and it was merged.
Change subject: Fix issue #2 Zimdump crashes on long titles.
..
Fix issue #2 Zimdump crashes on long titles.
Most of filesystems have a filename limited to 255 bytes.
If the f
Kelson has submitted this change and it was merged.
Change subject: Minor wording and typo fixes to the zimwriterfs README.
..
Minor wording and typo fixes to the zimwriterfs README.
Change-Id: Ia408f755b38f079f3063a6f0bc02ae95
Kelson has submitted this change and it was merged.
Change subject: Convert READMEs to markdown.
..
Convert READMEs to markdown.
Change-Id: I596bec7ef70bd0a7d45ba67d4fa313d93c861890
---
A README.md
D zimlib/README
A zimlib/READ
Kelson has submitted this change and it was merged.
Change subject: Update zimwriterfs makefiles.
..
Update zimwriterfs makefiles.
Change-Id: Ic0f93e19eb3e07d86c115bd15f47ef5fbc74f954
---
M zimwriterfs/Makefile.am
M zimwriterfs
Kelson has submitted this change and it was merged.
Change subject: Update .gitignore files.
..
Update .gitignore files.
Change-Id: Iad8d95fa2deab178396e8804b6e195a5b1520a4a
---
C zimlib/.gitignore
R zimwriterfs/.gitignore
2 fi
Kelson has submitted this change and it was merged.
Change subject: Use the system's libgumbo.
..
Use the system's libgumbo.
Change-Id: Id6b06033bba6c1d47d305b50259e7eaf41c073e2
---
M zimwriterfs/Makefile.am
M zimwriterfs/READM
Kelson has submitted this change and it was merged.
Change subject: Include files from srcdir; built files in builddir.
..
Include files from srcdir; built files in builddir.
Change-Id: I84f097567b944601534cdbc3313216c0364211bd
Kelson has submitted this change and it was merged.
Change subject: Update build instructions for MacOS X.
..
Update build instructions for MacOS X.
Change-Id: I0190ada3bf02c42ed34cb6d253516a9c662357e1
---
M zimlib/README.md
M
Kelson has submitted this change and it was merged.
Change subject: Move few utility functions to a separate module.
..
Move few utility functions to a separate module.
Change-Id: Ia26754d14f0cd6c557626675beb5a7c5fe2cadaa
---
M
Kelson has submitted this change and it was merged.
Change subject: Move article's related stuffs in article.(h|cpp).
..
Move article's related stuffs in article.(h|cpp).
Change-Id: I2a257ea1a0a13eca0748b444838a525666a9090d
---
Kelson has submitted this change and it was merged.
Change subject: Move articleSource's related stuffs in articlesource.(h|cpp).
..
Move articleSource's related stuffs in articlesource.(h|cpp).
Change-Id: Iee91484679bf401a693a
Kelson has submitted this change and it was merged.
Change subject: Use a Queue object to handle threadsafe access to a queue.
..
Use a Queue object to handle threadsafe access to a queue.
By using a Queue object we avoid the d
Kelson has submitted this change and it was merged.
Change subject: Compress blobs and track file size immediately after adding
each article.
..
Compress blobs and track file size immediately after adding each article.
Rather
Kelson has submitted this change and it was merged.
Change subject: Readd call to stripTitleInvalidChars.
..
Readd call to stripTitleInvalidChars.
Commit 1c969dd remove the call to stripTitleInvalidChars in Article.
This was a
Kelson has submitted this change and it was merged.
Change subject: Move zim::writer::ArticleSource::getData() to
zim::writer::Article::getData().
..
Move zim::writer::ArticleSource::getData() to zim::writer::Article::getData()
Kelson has submitted this change and it was merged.
Change subject: Move `throw` statement out of header file.
..
Move `throw` statement out of header file.
This ensures that we don't fail compilation when including the header
Kelson has submitted this change and it was merged.
Change subject: Bug fix: correctly update cluster offsets in directory entries.
..
Bug fix: correctly update cluster offsets in directory entries.
This is a follow-up to f5de4
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/343896 )
Change subject: Add the valuesmap metadata.
..
Add the valuesmap metadata.
This way, the searcher will know where values are stored.
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/333593 )
Change subject: pkg_config dependencies are properly declared.
..
pkg_config dependencies are properly declared.
The 'Requires' fiel
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/343898 )
Change subject: Few clean and better verbose message.
..
Few clean and better verbose message.
Change-Id: Id4675f70422ecef42198ca33f
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/343897 )
Change subject: Do not store the snippet nor the size of the content in the
database.
..
Do not store the snippet nor the size of th
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/344685 )
Change subject: Modify access rules
..
Modify access rules
Change-Id: I8ff42c3054bc6b67f0dba0e3ee96d101bde215d9
---
M project.config
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/343896 )
Change subject: Add the valuesmap metadata.
..
Add the valuesmap metadata.
This way, the searcher will know where values are stored.
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/333593 )
Change subject: pkg_config dependencies are properly declared.
..
pkg_config dependencies are properly declared.
The 'Requires' fiel
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/314721 )
Change subject: Always try to cache a cluster, even if it is a uncompressed one.
..
Always try to cache a cluster, even if it is a un
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/314719 )
Change subject: Remove unused currentPos from fstream.
..
Remove unused currentPos from fstream.
Change-Id: Idd7e392b35dbe36e5d4ee4a
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/330417 )
Change subject: Make zimlib compilable with meson.
..
Make zimlib compilable with meson.
Also install a correct pkg-config file who
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/344794 )
Change subject: Modify access rules
..
Modify access rules
Change-Id: Ifb79d6cb21c10144d5cce325136a3f68257b2ec9
---
M project.config
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/343898 )
Change subject: Few clean and better verbose message.
..
Few clean and better verbose message.
Change-Id: Id4675f70422ecef42198ca33f
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/330236 )
Change subject: Fix use of ENABLE_* by preprocessor.
..
Fix use of ENABLE_* by preprocessor.
If a compression lib is not present, th
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/329759 )
Change subject: Add libzim.pc for pkg-config
..
Add libzim.pc for pkg-config
This registers the libzim library with pkg-config, most
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/330861 )
Change subject: Provide time gap between uuid generation during tests
..
Provide time gap between uuid generation during tests
GNU M
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/315238 )
Change subject: [zimwriterfs] Try to avoid too big cluster.
..
[zimwriterfs] Try to avoid too big cluster.
We check that cluster wil
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/343897 )
Change subject: Do not store the snippet nor the size of the content in the
database.
..
Do not store the snippet nor the size of th
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/328341 )
Change subject: Make zimlib compilable with meson.
..
Make zimlib compilable with meson.
Also install a correct pkg-config file who
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/315237 )
Change subject: Do not cache uncompressed cluster by default.
..
Do not cache uncompressed cluster by default.
Uncompressed cluster
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/314717 )
Change subject: Avoid get the dirent too many time.
..
Avoid get the dirent too many time.
Article::is* functions are "alias" to Art
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/314718 )
Change subject: Read the cluster content only when necessary.
..
Read the cluster content only when necessary.
Instead of reading th
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/303778 )
Change subject: Better replaceStringInPlaceOnce.
..
Better replaceStringInPlaceOnce.
If we do only one replace, we do not need a whi
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/304240 )
Change subject: The indexed url must contain the namespace.
..
The indexed url must contain the namespace.
Change-Id: Icc17c7552a2b2
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/320243 )
Change subject: Adapt tests to new internal cluster API.
..
Adapt tests to new internal cluster API.
- There is no more operator>>()
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/304450 )
Change subject: Remove temporary ft_index.
..
Remove temporary ft_index.
Xapian indexer create temporary files while indexing conten
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/303775 )
Change subject: Fix memory leak in zimwriterfs.
..
Fix memory leak in zimwriterfs.
We are using polymorphism in articlesource.cpp (a
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/303777 )
Change subject: Close the magic database.
..
Close the magic database.
Change-Id: Ib0c7d1736d804526eea701ef39cb9ae5780b13c1
---
M zi
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/314720 )
Change subject: Invalidate internal streambuf buffer when we change it.
..
Invalidate internal streambuf buffer when we change it.
I
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/303776 )
Change subject: Delete all articles, even the last one.
..
Delete all articles, even the last one.
No so important, only one article
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/296914 )
Change subject: Add a API to get the offset of a article in the zimfile.
..
Add a API to get the offset of a article in the zimfile.
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/296931 )
Change subject: Fix issue #2 Zimdump crashes on long titles.
..
Fix issue #2 Zimdump crashes on long titles.
Most of filesystems hav
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/296915 )
Change subject: Handle the case of last article for filenameQueue is invalid.
..
Handle the case of last article for filenameQueue is
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/330859 )
Change subject: Support running tests with "make check"
..
Support running tests with "make check"
Change-Id: I1e15ba2dbda2f71c98baf
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/296912 )
Change subject: Add a indexer.
..
Add a indexer.
This indexer is not used.
This is mainly code from kiwix-indexer imported in openzi
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/296632 )
Change subject: Actually call the (previously-unused) ArticleSource#setFilename
method.
..
Actually call the (previously-unused) Art
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/296644 )
Change subject: Bug fix: don't store pointers inside a dynamic vector.
..
Bug fix: don't store pointers inside a dynamic vector.
Use
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/295516 )
Change subject: Move article's related stuffs in article.(h|cpp).
..
Move article's related stuffs in article.(h|cpp).
Change-Id: I2
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/296911 )
Change subject: Port zimwriterfs to the new API.
..
Port zimwriterfs to the new API.
No more ArticleSource::getData.
Change-Id: I76
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/295515 )
Change subject: Move few utility functions to a separate module.
..
Move few utility functions to a separate module.
Change-Id: Ia26
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/296913 )
Change subject: Add xapian indexer.
..
Add xapian indexer.
Xapian is optional.
Build your index inside zim by adding "-i" or "--crea
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/296752 )
Change subject: Revert "Use explicit LZMA_STREAM_INIT initializer, instead of
memset."
..
Revert "Use explicit LZMA_STREAM_INIT init
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/296910 )
Change subject: Revert compatibility with previous API.
..
Revert compatibility with previous API.
The API has changed. The behavior
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/295383 )
Change subject: Compress blobs and track file size immediately after adding
each article.
..
Compress blobs and track file size imme
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/296547 )
Change subject: Bug fix: preserve cluster compression type after clear().
..
Bug fix: preserve cluster compression type after clear()
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/295037 )
Change subject: Update .gitignore files.
..
Update .gitignore files.
Change-Id: Iad8d95fa2deab178396e8804b6e195a5b1520a4a
---
C ziml
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/295038 )
Change subject: Update zimwriterfs makefiles.
..
Update zimwriterfs makefiles.
Change-Id: Ic0f93e19eb3e07d86c115bd15f47ef5fbc74f954
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/296657 )
Change subject: Explain that ZIntStream only represents uint32_t values right
now.
..
Explain that ZIntStream only represents uint32
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/295518 )
Change subject: Use a Queue object to handle threadsafe access to a queue.
..
Use a Queue object to handle threadsafe access to a que
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/295720 )
Change subject: Move `throw` statement out of header file.
..
Move `throw` statement out of header file.
This ensures that we don't
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/296158 )
Change subject: Bug fix: correctly update cluster offsets in directory entries.
..
Bug fix: correctly update cluster offsets in direc
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/303540 )
Change subject: Fix memory corruption in decodeUrl.
..
Fix memory corruption in decodeUrl.
Reuse the function from kiwix as it does
Kelson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/295111 )
Change subject: Include files from srcdir; built files in builddir.
..
Include files from srcdir; built files in builddir.
Change-Id
1 - 100 of 123 matches
Mail list logo