[
https://issues.apache.org/jira/browse/TIKA-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18062215#comment-18062215
]
ASF GitHub Bot commented on TIKA-4606:
--------------------------------------
nddipiazza commented on PR #2655:
URL: https://github.com/apache/tika/pull/2655#issuecomment-3985762581
```
2026-03-02T15:55:33.3705449Z INFO [Thread-3] 15:55:33,220
org.apache.tika.pipes.ignite.IgniteConfigStoreTest tika-grpc: Mar 02, 2026
3:55:33 PM org.apache.ignite.internal.logger.IgniteLoggerImpl logInternal
2026-03-02T15:55:33.3706499Z INFO [Thread-3] 15:55:33,220
org.apache.tika.pipes.ignite.IgniteConfigStoreTest tika-grpc: INFO: Waiting for
actual storage state, group=0_part_24
2026-03-02T15:55:33.3707543Z INFO [Thread-3] 15:55:33,220
org.apache.tika.pipes.ignite.IgniteConfigStoreTest tika-grpc: Mar 02, 2026
3:55:33 PM org.apache.ignite.internal.logger.IgniteLoggerImpl logInternal
2026-03-02T15:55:33.3708879Z INFO [Thread-3] 15:55:33,220
org.apache.tika.pipes.ignite.IgniteConfigStoreTest tika-grpc: INFO: Lease
accepted [group=0_part_23, leaseStartTime=HybridTimestamp [physical=2026-03-02
15:55:33:201 +0000, logical=23, composite=116160392934260759]].
2026-03-02T15:55:33.3710204Z INFO [Thread-3] 15:55:33,220
org.apache.tika.pipes.ignite.IgniteConfigStoreTest tika-grpc: Mar 02, 2026
3:55:33 PM org.apache.ignite.internal.logger.IgniteLoggerImpl logInternal
2026-03-02T15:55:33.3711534Z INFO [Thread-3] 15:55:33,220
org.apache.tika.pipes.ignite.IgniteConfigStoreTest tika-grpc: INFO: Lease
accepted [group=0_part_22, leaseStartTime=HybridTimestamp [physical=2026-03-02
15:55:33:201 +0000, logical=22, composite=116160392934260758]].
2026-03-02T15:55:33.3712862Z INFO [Thread-3] 15:55:33,221
org.apache.tika.pipes.ignite.IgniteConfigStoreTest tika-grpc: Mar 02, 2026
3:55:33 PM org.apache.ignite.internal.logger.IgniteLoggerImpl logInternal
2026-03-02T15:55:33.3714191Z INFO [Thread-3] 15:55:33,221
org.apache.tika.pipes.ignite.IgniteConfigStoreTest tika-grpc: INFO: Lease
accepted [group=0_part_24, leaseStartTime=HybridTimestamp [physical=2026-03-02
15:55:33:201 +0000, logical=24, composite=116160392934260760]].
2026-03-02T15:55:33.9330473Z INFO [awaitility-thread] 15:55:33,929
org.apache.tika.pipes.ignite.IgniteConfigStoreTest gRPC server is healthy and
serving!
2026-03-02T15:55:33.9333268Z INFO [main] 15:55:33,931
org.apache.tika.pipes.ignite.IgniteConfigStoreTest Both gRPC server and Ignite
are ready!
2026-03-02T15:55:33.9334970Z INFO [main] 15:55:33,931
org.apache.tika.pipes.ignite.IgniteConfigStoreTest Local tika-grpc server
started successfully on port 50052
2026-03-02T15:55:33.9528326Z INFO [main] 15:55:33,935
org.apache.tika.pipes.ignite.IgniteConfigStoreTest Creating fetcher with Ignite
ConfigStore
(basePath=/home/runner/work/tika/tika/tika-e2e-tests/tika-grpc/target/govdocs1):
{"basePath":"/home/runner/work/tika/tika/tika-e2e-tests/tika-grpc/target/govdocs1","extractFileSystemMetadata":false,"allowAbsolutePaths":false}
2026-03-02T15:55:33.9531513Z INFO [main] 15:55:33,948
org.apache.tika.pipes.ignite.IgniteConfigStoreTest Fetcher saved to Ignite:
dynamicIgniteFetcher
2026-03-02T15:55:33.9532927Z INFO [main] 15:55:33,949
org.apache.tika.pipes.ignite.IgniteConfigStoreTest Document limit: 2
2026-03-02T15:55:33.9534339Z INFO [main] 15:55:33,951
org.apache.tika.pipes.ignite.IgniteConfigStoreTest Done submitting files to
Ignite-backed fetcher dynamicIgniteFetcher
2026-03-02T15:55:34.1619847Z INFO [pool-13-thread-2] 15:55:34,159
org.apache.tika.pipes.ignite.IgniteConfigStoreTest Finished streaming fetch and
parse replies
2026-03-02T15:55:34.1620970Z INFO [main] 15:55:34,159
org.apache.tika.pipes.ignite.IgniteConfigStoreTest Processed 2 documents with
Ignite ConfigStore (limit was 2)
2026-03-02T15:55:34.1622108Z INFO [main] 15:55:34,159
org.apache.tika.pipes.ignite.IgniteConfigStoreTest Ignite ConfigStore test
completed successfully - 2 successes, 0 errors
2026-03-02T15:55:34.2523225Z INFO [main] 15:55:34,161
org.apache.tika.pipes.ignite.IgniteConfigStoreTest Stopping local gRPC server
and all child processes
2026-03-02T15:55:34.2524284Z INFO [main] 15:55:34,161
org.apache.tika.pipes.ignite.IgniteConfigStoreTest Maven process PID: 31856
2026-03-02T15:55:36.6547045Z INFO [main] 15:55:36,596
org.apache.tika.pipes.ignite.IgniteConfigStoreTest Found process 31928
listening on port 3344, killing it
2026-03-02T15:55:37.6505252Z INFO [main] 15:55:37,647
org.apache.tika.pipes.ignite.IgniteConfigStoreTest Local gRPC server stopped
2026-03-02T15:55:37.6603917Z [INFO] Tests run: 1, Failures: 0, Errors: 0,
Skipped: 0, Time elapsed: 17.91 s
> Upgrade Ignite config store to Ignite 3.x with Calcite SQL engine
> -----------------------------------------------------------------
>
> Key: TIKA-4606
> URL: https://issues.apache.org/jira/browse/TIKA-4606
> Project: Tika
> Issue Type: Improvement
> Reporter: Nicholas DiPiazza
> Assignee: Nicholas DiPiazza
> Priority: Major
>
> h2. Overview
> Upgrade the tika-pipes-config-store-ignite module from Apache Ignite 2.17.0
> (which uses H2 1.4.x) to Apache Ignite 3.x (which uses Apache Calcite SQL
> engine).
> h2. Current State
> * Module: *tika-pipes-config-store-ignite*
> * Ignite Version: 2.17.0
> * SQL Engine: H2 1.4.197 (embedded)
> * Location: {{tika-pipes/tika-pipes-config-store-ignite/}}
> h2. Goals
> # Upgrade to Apache Ignite 3.x (latest stable release)
> # Replace H2 SQL engine with Calcite-based SQL engine
> # Maintain all existing functionality for config store
> # Update API calls to match Ignite 3.x breaking changes
> # Ensure backward compatibility for stored configurations (if possible)
> h2. Benefits
> * Modern SQL engine with Apache Calcite
> * Better performance and query optimization
> * Active maintenance and future support
> * Improved SQL feature set
> * No dependency on old H2 1.4.x (2018)
> h2. Breaking Changes to Address
> * Ignite 3.x has major API changes from 2.x
> * Configuration format changes
> * Cache API differences
> * SQL query API updates
> * Client connection changes
> h2. Implementation Steps
> # Research Ignite 3.x API changes and migration guide
> # Update Maven dependencies to Ignite 3.x
> # Refactor {{IgniteConfigStore}} to use new Ignite 3.x API
> # Update {{IgniteStoreServer}} for new connection model
> # Modify SQL queries if needed for Calcite compatibility
> # Update configuration handling
> # Update tests to work with Ignite 3.x
> # Test backward compatibility with existing configs
> # Update documentation
> h2. Acceptance Criteria
> * Ignite upgraded to version 3.x (latest stable)
> * Uses Calcite SQL engine instead of H2
> * All existing tests pass
> * Config store functionality preserved
> * No H2 dependencies remain
> * Documentation updated
> h2. References
> * Apache Ignite 3.x: https://ignite.apache.org/docs/3.0.0/
> * Ignite 3.x Migration Guide
> * Apache Calcite: https://calcite.apache.org/
> * Current module: {{tika-pipes/tika-pipes-config-store-ignite/}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
