rzo1 opened a new pull request, #1898:
URL: https://github.com/apache/stormcrawler/pull/1898

   Heuristically flags URLs whose content looks JavaScript-rendered by
   inspecting SPA framework fingerprints, noscript blocks, empty hydration
   roots, and a thin-content fallback. Sets a routing metadata key so
   DelegatorProtocol can dispatch subsequent fetches to Playwright while
   the bulk of the crawl stays on a cheap HTTP client.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to