dev  

Messages by Thread

• [PR] build(deps): bump actions/setup-java from 6.0.1 to 6.1.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump actions/setup-java from 6.0.1 to 6.1.0 [stormcrawler] via GitHub
• [PR] build(deps): bump software.amazon.awssdk:bom from 2.55.13 to 2.56.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump software.amazon.awssdk:bom from 2.55.13 to 2.56.0 [stormcrawler] via GitHub
• [PR] build(deps): bump com.github.ben-manes.caffeine:caffeine from 3.3.0 to 3.3.1 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump com.github.ben-manes.caffeine:caffeine from 3.3.0 to 3.3.1 [stormcrawler] via GitHub
• [GH] (stormcrawler/2145-punycode-host-keys): Workflow run "Java CI with Maven" failed! GitBox
• [PR] #2145 Punycode the host in politeness, partition and robots.txt keys [stormcrawler] via GitHub
  • Re: [PR] #2145 Punycode the host in politeness, partition and robots.txt keys [stormcrawler] via GitHub
  • Re: [PR] #2145 Punycode the host in politeness, partition and robots.txt keys [stormcrawler] via GitHub
  • Re: [PR] #2145 Punycode the host in politeness, partition and robots.txt keys [stormcrawler] via GitHub
• [PR] #2212 retry 429 items and flush bulk requests by size [stormcrawler] via GitHub
  • Re: [PR] #2212 retry 429 items and flush bulk requests by size [stormcrawler] via GitHub
  • Re: [PR] #2212 retry 429 items and flush bulk requests by size [stormcrawler] via GitHub
  • Re: [PR] #2212 retry 429 items and flush bulk requests by size [stormcrawler] via GitHub
• [PR] #2212 move the opensearch-java implementation into external/opensearch [stormcrawler] via GitHub
  • Re: [PR] #2212 move the opensearch-java implementation into external/opensearch [stormcrawler] via GitHub
  • Re: [PR] #2212 move the opensearch-java implementation into external/opensearch [stormcrawler] via GitHub
• [GH] (stormcrawler/migrate-httpclient5): Workflow run "Java CI with Maven" is working again! GitBox
• [GH] (stormcrawler/regenerate_license_file_after_dep_upgrade): Workflow run "Java CI with Maven" is working again! GitBox
• [PR] build(deps): bump software.amazon.awssdk:bom from 2.55.10 to 2.55.13 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump software.amazon.awssdk:bom from 2.55.10 to 2.55.13 [stormcrawler] via GitHub
• [PR] build(deps): bump commons-codec:commons-codec from 1.22.1 to 1.23.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump commons-codec:commons-codec from 1.22.1 to 1.23.0 [stormcrawler] via GitHub
• [GH] (stormcrawler/codex/prevent-slash-query-unmangling): Workflow run "Java CI with Maven" failed! GitBox
• [PR] opensearch-java: fix the search_after values sent by HybridSpout [stormcrawler] via GitHub
  • Re: [PR] opensearch-java: fix the search_after values sent by HybridSpout [stormcrawler] via GitHub
  • Re: [PR] opensearch-java: fix the search_after values sent by HybridSpout [stormcrawler] via GitHub
• [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
  • Re: [PR] #2211 Migrate core to HttpClient 5 and preserve parsing behavior [stormcrawler] via GitHub
• [GH] (stormcrawler/urlfrontier-spout-query-time): Workflow run "Java CI with Maven" is working again! GitBox
• [PR] URLFrontier Spout: report the query time [stormcrawler] via GitHub
  • Re: [PR] URLFrontier Spout: report the query time [stormcrawler] via GitHub
• [GH] (stormcrawler/dependabot/maven/commons-codec-commons-codec-1.23.0): Workflow run "Java CI with Maven" is working again! GitBox
• [PR] build(deps): bump langchain4j.version from 1.20.2 to 1.22.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump langchain4j.version from 1.20.2 to 1.22.0 [stormcrawler] via GitHub
• [PR] Add a Prometheus reporter for the Storm V2 metrics [stormcrawler] via GitHub
  • Re: [PR] Add a Prometheus reporter for the Storm V2 metrics [stormcrawler] via GitHub
  • Re: [PR] Add a Prometheus reporter for the Storm V2 metrics [stormcrawler] via GitHub
  • Re: [PR] Add a Prometheus reporter for the Storm V2 metrics [stormcrawler] via GitHub
  • Re: [PR] Add a Prometheus reporter for the Storm V2 metrics [stormcrawler] via GitHub
• [GH] (stormcrawler/status-updater-cache-counters): Workflow run "Java CI with Maven" is working again! GitBox
• [PR] fix: preserve query strings containing slashes [stormcrawler] via GitHub
  • Re: [PR] #2198 preserve query strings containing slashes [stormcrawler] via GitHub
  • Re: [PR] #2198 preserve query strings containing slashes [stormcrawler] via GitHub
• [PR] AbstractStatusUpdaterBolt: report cache hits/misses with a counter, not reset-on-read gauges [stormcrawler] via GitHub
  • Re: [PR] AbstractStatusUpdaterBolt: report cache hits/misses with a counter, not reset-on-read gauges [stormcrawler] via GitHub
• [GH] (stormcrawler/1901-pdf-max-pages): Workflow run "Java CI with Maven" is working again! GitBox
• [GH] (stormcrawler/proxy-round-robin): Workflow run "Java CI with Maven" is working again! GitBox
• [PR] MultiProxyManager: thread-safe round-robin rotation [stormcrawler] via GitHub
  • Re: [PR] MultiProxyManager: thread-safe round-robin rotation [stormcrawler] via GitHub
• [PR] #1901 Tika ParserBolt: limit the pages parsed in a PDF with parser.tika.pdf.maxpages [stormcrawler] via GitHub
  • Re: [PR] #1901 Tika ParserBolt: limit the pages parsed in a PDF with parser.tika.pdf.maxpages [stormcrawler] via GitHub
  • Re: [PR] #1901 Tika ParserBolt: limit the pages parsed in a PDF with parser.tika.pdf.maxpages [stormcrawler] via GitHub
  • Re: [PR] #1901 Tika ParserBolt: limit the pages parsed in a PDF with parser.tika.pdf.maxpages [stormcrawler] via GitHub
• Re: [I] URLPartitionerBolt to partition on arbitrary metadata value [stormcrawler] via GitHub
  • Re: [I] URLPartitionerBolt to partition on arbitrary metadata value [stormcrawler] via GitHub
  • Re: [I] URLPartitionerBolt to partition on arbitrary metadata value [stormcrawler] via GitHub
• [GH] (stormcrawler/spout-benchmark): Workflow run "Java CI with Maven" is working again! GitBox
• [PR] Add SpoutBenchmark to measure the read performance of spouts [stormcrawler] via GitHub
  • Re: [PR] Add SpoutBenchmark to measure the read performance of spouts [stormcrawler] via GitHub
• [GH] (stormcrawler/2197): Workflow run "Java CI with Maven" failed! GitBox
• [PR] opensearch-java: send bulk requests with the OpenSearchAsyncClient [stormcrawler] via GitHub
  • Re: [PR] opensearch-java: send bulk requests with the OpenSearchAsyncClient [stormcrawler] via GitHub
  • Re: [PR] opensearch-java: send bulk requests with the OpenSearchAsyncClient [stormcrawler] via GitHub
  • Re: [PR] opensearch-java: send bulk requests with the OpenSearchAsyncClient [stormcrawler] via GitHub
• [PR] URLFrontier StatusUpdaterBolt: cheaper bookkeeping of the acks [stormcrawler] via GitHub
  • Re: [PR] URLFrontier StatusUpdaterBolt: cheaper bookkeeping of the acks [stormcrawler] via GitHub
• [PR] StatusUpdaterBenchmark: run several instances of the status updater in parallel [stormcrawler] via GitHub
  • Re: [PR] StatusUpdaterBenchmark: run several instances of the status updater in parallel [stormcrawler] via GitHub
• [PR] build(deps): bump org.apache.commons:commons-lang3 from 3.20.0 to 3.21.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump org.apache.commons:commons-lang3 from 3.20.0 to 3.21.0 [stormcrawler] via GitHub
• [PR] build(deps): bump com.puppycrawl.tools:checkstyle from 14.1.0 to 14.3.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump com.puppycrawl.tools:checkstyle from 14.1.0 to 14.3.0 [stormcrawler] via GitHub
• [PR] build(deps): bump com.google.guava:guava from 33.7.1-jre to 33.7.2-jre [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump com.google.guava:guava from 33.7.1-jre to 33.7.2-jre [stormcrawler] via GitHub
• [PR] build(deps): bump git-code-format-maven-plugin.version from 6.1 to 6.2 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump git-code-format-maven-plugin.version from 6.1 to 6.2 [stormcrawler] via GitHub
• [PR] build(deps): bump software.amazon.awssdk:bom from 2.55.5 to 2.55.10 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump software.amazon.awssdk:bom from 2.55.5 to 2.55.10 [stormcrawler] via GitHub
• [PR] build(deps): bump langchain4j.version from 1.20.0 to 1.20.2 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump langchain4j.version from 1.20.0 to 1.20.2 [stormcrawler] via GitHub
• [PR] #2214 Manage the Jackson dataformat/datatype versions in the root pom [stormcrawler] via GitHub
  • Re: [PR] #2214 Manage the Jackson dataformat/datatype versions in the root pom [stormcrawler] via GitHub
• [GH] (stormcrawler/statusupdaterbenchmark): Workflow run "Java CI with Maven" failed! GitBox
• [PR] Add StatusUpdaterBenchmark to measure the performance of status updater backends [stormcrawler] via GitHub
  • Re: [PR] Add StatusUpdaterBenchmark to measure the performance of status updater backends [stormcrawler] via GitHub
  • Re: [PR] Add StatusUpdaterBenchmark to measure the performance of status updater backends [stormcrawler] via GitHub
• [I] Keep opensearch-java and remove opensearch module? [stormcrawler] via GitHub
  • Re: [I] Keep 'opensearch-java' and remove the older 'opensearch' module? [stormcrawler] via GitHub
  • Re: [I] Keep 'opensearch-java' and remove the older 'opensearch' module? [stormcrawler] via GitHub
  • Re: [I] Keep 'opensearch-java' and remove the older 'opensearch' module? [stormcrawler] via GitHub
  • Re: [I] Keep 'opensearch-java' and remove the older 'opensearch' module? [stormcrawler] via GitHub
  • Re: [I] Keep 'opensearch-java' and remove the older 'opensearch' module? [stormcrawler] via GitHub
  • Re: [I] Keep 'opensearch-java' and remove the older 'opensearch' module? [stormcrawler] via GitHub
  • Re: [I] Keep 'opensearch-java' and remove the older 'opensearch' module? [stormcrawler] via GitHub
• [I] Migrate core from HttpClient 4.x to HttpClient 5.x [stormcrawler] via GitHub
  • Re: [I] Migrate core from HttpClient 4.x to HttpClient 5.x [stormcrawler] via GitHub
  • Re: [I] Migrate core from HttpClient 4.x to HttpClient 5.x [stormcrawler] via GitHub
  • Re: [I] Migrate core from HttpClient 4.x to HttpClient 5.x [stormcrawler] via GitHub
• [PR] Upgrade to Tika 4.1.0 [stormcrawler] via GitHub
  • Re: [PR] Upgrade to Tika 4.1.0 [stormcrawler] via GitHub
• [PR] #2057 FetcherBolt: move the fetcher internals to o.a.s.fetcher [stormcrawler] via GitHub
  • Re: [PR] #2057 FetcherBolt: move the fetcher internals to o.a.s.fetcher [stormcrawler] via GitHub
  • Re: [PR] #2057 FetcherBolt: move the fetcher internals to o.a.s.fetcher [stormcrawler] via GitHub
  • Re: [PR] #2057 FetcherBolt: move the fetcher internals to o.a.s.fetcher [stormcrawler] via GitHub
• [I] Upgrade to Tika 4.1.0 [stormcrawler] via GitHub
  • Re: [I] Upgrade to Tika 4.1.0 [stormcrawler] via GitHub
  • Re: [I] Upgrade to Tika 4.1.0 [stormcrawler] via GitHub
• [I] [Bug report] BasicURLNormalizer folds the query into the path when it rebuilds a URL [stormcrawler] via GitHub
  • Re: [I] [Bug report] BasicURLNormalizer folds the query into the path when it rebuilds a URL [stormcrawler] via GitHub
• [PR] #2057 FetcherBolt: extract the sitemap autodiscovery [stormcrawler] via GitHub
  • Re: [PR] #2057 FetcherBolt: extract the sitemap autodiscovery [stormcrawler] via GitHub
• [I] URLNormalizer The query is split on `;` as well as `&`, which rewrites URLs [stormcrawler] via GitHub
• [PR] #2197 BasicURLNormalizer keeps the query when rebuilding a URL [stormcrawler] via GitHub
  • Re: [PR] #2197 BasicURLNormalizer keeps the query when rebuilding a URL [stormcrawler] via GitHub
  • Re: [PR] #2197 BasicURLNormalizer keeps the query when rebuilding a URL [stormcrawler] via GitHub
  • Re: [PR] #2197 BasicURLNormalizer keeps the query when rebuilding a URL [stormcrawler] via GitHub
  • Re: [PR] #2197 BasicURLNormalizer keeps the query when rebuilding a URL [stormcrawler] via GitHub
• [PR] #2057 FetcherBolt: extract the crawl-delay policy [stormcrawler] via GitHub
  • Re: [PR] #2057 FetcherBolt: extract the crawl-delay policy [stormcrawler] via GitHub
• [PR] #2057 FetcherBolt: extract the response and failure handling [stormcrawler] via GitHub
  • Re: [PR] #2057 FetcherBolt: extract the response and failure handling [stormcrawler] via GitHub
  • Re: [PR] #2057 FetcherBolt: extract the response and failure handling [stormcrawler] via GitHub
  • Re: [PR] #2057 FetcherBolt: extract the response and failure handling [stormcrawler] via GitHub
  • Re: [PR] #2057 FetcherBolt: extract the response and failure handling [stormcrawler] via GitHub
  • Re: [PR] #2057 FetcherBolt: extract the response and failure handling [stormcrawler] via GitHub
• [PR] #2057 FetcherBolt: extract the robots.txt lookup [stormcrawler] via GitHub
  • Re: [PR] #2057 FetcherBolt: extract the robots.txt lookup [stormcrawler] via GitHub
• [PR] #2057 FetcherBolt: move the fetch queue classes to their own files [stormcrawler] via GitHub
  • Re: [PR] #2057 FetcherBolt: move the fetch queue classes to their own files [stormcrawler] via GitHub
• [PR] #2057 FetcherBolt: add characterization tests [stormcrawler] via GitHub
  • Re: [PR] #2057 FetcherBolt: add characterization tests [stormcrawler] via GitHub
• [I] [Bug report] BasicURLNormalizer unmangleQueryString inserts a second `?` when a query value contains a `/` [stormcrawler] via GitHub
• [PR] build(deps): bump com.github.ben-manes.caffeine:caffeine from 3.2.4 to 3.3.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump com.github.ben-manes.caffeine:caffeine from 3.2.4 to 3.3.0 [stormcrawler] via GitHub
• [PR] build(deps): bump org.apache:apache from 39 to 40 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump org.apache:apache from 39 to 40 [stormcrawler] via GitHub
• [PR] build(deps): bump software.amazon.awssdk:bom from 2.55.0 to 2.55.5 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump software.amazon.awssdk:bom from 2.55.0 to 2.55.5 [stormcrawler] via GitHub
• [PR] build(deps): bump git-code-format-maven-plugin.version from 6.0 to 6.1 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump git-code-format-maven-plugin.version from 6.0 to 6.1 [stormcrawler] via GitHub
• [PR] build(deps): bump org.mockito:mockito-core from 5.23.0 to 5.24.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump org.mockito:mockito-core from 5.23.0 to 5.24.0 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump org.mockito:mockito-core from 5.23.0 to 5.24.0 [stormcrawler] via GitHub
• [PR] build(deps): bump org.slf4j:slf4j-simple from 2.0.19 to 2.0.20 [stormcrawler] via GitHub
  • Re: [PR] build(deps): bump org.slf4j:slf4j-simple from 2.0.19 to 2.0.20 [stormcrawler] via GitHub
• [PR] build(deps-dev): bump de.thetaphi:forbiddenapis from 3.10 to 3.11 [stormcrawler] via GitHub
  • Re: [PR] build(deps-dev): bump de.thetaphi:forbiddenapis from 3.10 to 3.11 [stormcrawler] via GitHub
• [PR] Bring back the logo in the README [stormcrawler] via GitHub
  • Re: [PR] Bring back the logo in the README [stormcrawler] via GitHub
• [PR] #2185 URLFrontier Spout: depth metrics to observe the breadth of the crawl [stormcrawler] via GitHub
  • Re: [PR] #2185 URLFrontier Spout: depth metrics to observe the breadth of the crawl [stormcrawler] via GitHub
  • Re: [PR] #2185 URLFrontier Spout: depth metrics to observe the breadth of the crawl [stormcrawler] via GitHub
  • Re: [PR] #2185 URLFrontier Spout: depth metrics to observe the breadth of the crawl [stormcrawler] via GitHub
• [I] URLFrontier Spout: depth metrics to observe and drive the breadth of the crawl [stormcrawler] via GitHub
  • Re: [I] URLFrontier Spout: depth metrics to observe and drive the breadth of the crawl [stormcrawler] via GitHub
  • Re: [I] URLFrontier Spout: depth metrics to observe and drive the breadth of the crawl [stormcrawler] via GitHub
  • Re: [I] URLFrontier Spout: depth metrics to observe and drive the breadth of the crawl [stormcrawler] via GitHub
  • Re: [I] URLFrontier Spout: depth metrics to observe and drive the breadth of the crawl [stormcrawler] via GitHub
  • Re: [I] URLFrontier Spout: depth metrics to observe and drive the breadth of the crawl [stormcrawler] via GitHub
  • Re: [I] URLFrontier Spout: depth metrics to observe and drive the breadth of the crawl [stormcrawler] via GitHub
  • Re: [I] URLFrontier Spout: depth metrics to observe and drive the breadth of the crawl [stormcrawler] via GitHub
  • Re: [I] URLFrontier Spout: depth metrics to observe and drive the breadth of the crawl [stormcrawler] via GitHub
• [GH] (stormcrawler/fix/2058-queue-timeout-metric): Workflow run "Java CI with Maven" is working again! GitBox
• [GH] (stormcrawler/fix/2058-queue-timeout-metric): Workflow run "Java CI with Maven" failed! GitBox
• [PR] #2058 FetcherBolt: count the URLs dropped by fetcher.timeout.queue [stormcrawler] via GitHub
  • Re: [PR] #2058 FetcherBolt: count the URLs dropped by fetcher.timeout.queue [stormcrawler] via GitHub
• [GH] (stormcrawler/tika-pipes-parser-timeout): Workflow run "Java CI with Maven" is working again! GitBox
  • [GH] (stormcrawler/tika-pipes-parser-timeout): Workflow run "Java CI with Maven" is working again! GitBox
  • [GH] (stormcrawler/tika-pipes-parser-timeout): Workflow run "Java CI with Maven" is working again! GitBox
• [GH] (stormcrawler/tika-pipes-parser-timeout): Workflow run "Java CI with Maven" failed! GitBox
  • [GH] (stormcrawler/tika-pipes-parser-timeout): Workflow run "Java CI with Maven" failed! GitBox
  • [GH] (stormcrawler/tika-pipes-parser-timeout): Workflow run "Java CI with Maven" failed! GitBox
• [PR] Tika pipes parser timeout [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub
  • Re: [PR] 2097: Isolate tika parsing via tika-pipes to ensure reliable timeouts and protection from OOMs [stormcrawler] via GitHub

• Earlier messages