Irinel commented on NUTCH-2310:


I think we need to change more things, not just HttpResponse.java.

Now the error is on ProtocolFactory:

-activeThreads=1, spinWaiting=0, fetchQueues.totalSize=0, 
FetcherThread 41 fetching https://www.***.com (queue crawl delay=2000ms)
FetcherThread 41 fetch of https://www.***.com failed with: 
org.apache.nutch.protocol.ProtocolNotFound: protocol not found for url=https
 at org.apache.nutch.fetcher.FetcherThread.run(FetcherThread.java:300)


> Protocol-Selenium does not support HTTPS protocol
> -------------------------------------------------
>                 Key: NUTCH-2310
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2310
>             Project: Nutch
>          Issue Type: Bug
>          Components: protocol
>    Affects Versions: 1.12
>            Reporter: Joey Hong
>            Priority: Major
>              Labels: easyfix
>             Fix For: 1.15
>   Original Estimate: 48h
>  Remaining Estimate: 48h
> The protocol-selenium and protocol-interactiveselenium plugins raise errors 
> whenever there is a URL with the HTTPS protocol.
>  From the source code for those plugins, we can see that HTTP is the only 
> scheme currently accepted, which makes Nutch unable to crawl HTTPS sites with 
> JS using Selenium Webdrivers. 

This message was sent by Atlassian JIRA

Reply via email to