Re: Nutch 1.11 SSLHandshakeException

2018-03-20 Thread Robert Scavilla 
Again I thank you Sebastian! I was able to resolve the issue by updating
the HTTPClient library. I also updated from Nutch 1.11 to 1.14 and had no
issue with the SSL.

Best,
...bob


On Tue, Mar 20, 2018 at 5:03 PM, Sebastian Nagel  wrote:

> Hi Robert,
>
> although the error message differs, somewhat resembles
>   https://issues.apache.org/jira/browse/NUTCH-2447
>
> I've tried to reproduce it using Nutch 1.11, but it works
> with Java 8 on Ubuntu 16.04. Sorry, I have no glue where even
> to start searching for the reason.
>
> Best,
> Sebastian
>
>
> On 03/20/2018 09:00 PM, Robert Scavilla wrote:
> > Thank you Sebastian! I am still working on the issue. I tested the cert
> > using openssl and also got the same handshake failure. After further
> > checking I found that the openssl command works when I add the
> -servername
> > option. So apparently, my nutch server (Fedora 27) requires SNI. I added
> > -Djsse.enableSNIExtension=false and true to NUTCH_OPTS but still no
> > success.
> >
> >  Is there anything else you can think of to allow nutch to work around
> the
> > SNI issue?
> >
> > Thank you in advance for your help,
> > ...bob
> >
> >
> > On Tue, Mar 20, 2018 at 3:31 AM, Sebastian Nagel <
> wastl.na...@googlemail.com
> >> wrote:
> >
> >> Hi Robert,
> >>
> >> unfortunately, I'm not able to reproduce the problem.
> >> Fetching works with the recent 1.x and Java 8, I've tried both:
> >>
> >>   bin/nutch parsechecker -Dplugin.includes='protocol-http|parse-html'
> >> https://potomac.edu/
> >>
> >>   bin/nutch parsechecker -Dplugin.includes='protocol-
> httpclient|parse-html'
> >> https://potomac.edu/
> >>
> >> Best,
> >> Sebastian
> >>
> >>
> >> On 03/20/2018 12:49 AM, Robert Scavilla wrote:
> >>> Hi, I'm stuck on this problem and would appreciate any help. I'm using
> >>> nutch 1.11
> >>> plugin-includes:
> >>> protocol-http|urlfilter-regex
> >>>
> >>> Running indexchecker generates error for only one site:
>  apache-nutch-1.11/runtime/local/bin/nutch indexchecker
> >> https://potomac.edu/
> >>>
> >>> Error message:
> >>> httpclient.Http - Failed to get protocol output
> >>> javax.net.ssl.SSLHandshakeException: Received fatal alert:
> >> handshake_failure
> >>>
> >>> I've manually added certificate in cacerts file
> >>>
> >>> I'm out of ideas - thank you for helping,
> >>> ...bob
> >>>
> >>
> >>
> >
>
>

Re: Nutch 1.11 SSLHandshakeException

2018-03-20 Thread Sebastian Nagel 
Hi Robert,

although the error message differs, somewhat resembles
  https://issues.apache.org/jira/browse/NUTCH-2447

I've tried to reproduce it using Nutch 1.11, but it works
with Java 8 on Ubuntu 16.04. Sorry, I have no glue where even
to start searching for the reason.

Best,
Sebastian


On 03/20/2018 09:00 PM, Robert Scavilla wrote:
> Thank you Sebastian! I am still working on the issue. I tested the cert
> using openssl and also got the same handshake failure. After further
> checking I found that the openssl command works when I add the -servername
> option. So apparently, my nutch server (Fedora 27) requires SNI. I added
> -Djsse.enableSNIExtension=false and true to NUTCH_OPTS but still no
> success.
> 
>  Is there anything else you can think of to allow nutch to work around the
> SNI issue?
> 
> Thank you in advance for your help,
> ...bob
> 
> 
> On Tue, Mar 20, 2018 at 3:31 AM, Sebastian Nagel > wrote:
> 
>> Hi Robert,
>>
>> unfortunately, I'm not able to reproduce the problem.
>> Fetching works with the recent 1.x and Java 8, I've tried both:
>>
>>   bin/nutch parsechecker -Dplugin.includes='protocol-http|parse-html'
>> https://potomac.edu/
>>
>>   bin/nutch parsechecker -Dplugin.includes='protocol-httpclient|parse-html'
>> https://potomac.edu/
>>
>> Best,
>> Sebastian
>>
>>
>> On 03/20/2018 12:49 AM, Robert Scavilla wrote:
>>> Hi, I'm stuck on this problem and would appreciate any help. I'm using
>>> nutch 1.11
>>> plugin-includes:
>>> protocol-http|urlfilter-regex
>>>
>>> Running indexchecker generates error for only one site:
 apache-nutch-1.11/runtime/local/bin/nutch indexchecker
>> https://potomac.edu/
>>>
>>> Error message:
>>> httpclient.Http - Failed to get protocol output
>>> javax.net.ssl.SSLHandshakeException: Received fatal alert:
>> handshake_failure
>>>
>>> I've manually added certificate in cacerts file
>>>
>>> I'm out of ideas - thank you for helping,
>>> ...bob
>>>
>>
>>
>

Re: Nutch 1.11 SSLHandshakeException

2018-03-20 Thread Robert Scavilla 
Thank you Sebastian! I am still working on the issue. I tested the cert
using openssl and also got the same handshake failure. After further
checking I found that the openssl command works when I add the -servername
option. So apparently, my nutch server (Fedora 27) requires SNI. I added
-Djsse.enableSNIExtension=false and true to NUTCH_OPTS but still no
success.

 Is there anything else you can think of to allow nutch to work around the
SNI issue?

Thank you in advance for your help,
...bob


On Tue, Mar 20, 2018 at 3:31 AM, Sebastian Nagel  wrote:

> Hi Robert,
>
> unfortunately, I'm not able to reproduce the problem.
> Fetching works with the recent 1.x and Java 8, I've tried both:
>
>   bin/nutch parsechecker -Dplugin.includes='protocol-http|parse-html'
> https://potomac.edu/
>
>   bin/nutch parsechecker -Dplugin.includes='protocol-httpclient|parse-html'
> https://potomac.edu/
>
> Best,
> Sebastian
>
>
> On 03/20/2018 12:49 AM, Robert Scavilla wrote:
> > Hi, I'm stuck on this problem and would appreciate any help. I'm using
> > nutch 1.11
> > plugin-includes:
> > protocol-http|urlfilter-regex
> >
> > Running indexchecker generates error for only one site:
> >> apache-nutch-1.11/runtime/local/bin/nutch indexchecker
> https://potomac.edu/
> >
> > Error message:
> > httpclient.Http - Failed to get protocol output
> > javax.net.ssl.SSLHandshakeException: Received fatal alert:
> handshake_failure
> >
> > I've manually added certificate in cacerts file
> >
> > I'm out of ideas - thank you for helping,
> > ...bob
> >
>
>

Re: Nutch 1.11 SSLHandshakeException

2018-03-20 Thread Sebastian Nagel 
Hi Robert,

unfortunately, I'm not able to reproduce the problem.
Fetching works with the recent 1.x and Java 8, I've tried both:

  bin/nutch parsechecker -Dplugin.includes='protocol-http|parse-html' 
https://potomac.edu/

  bin/nutch parsechecker -Dplugin.includes='protocol-httpclient|parse-html' 
https://potomac.edu/

Best,
Sebastian


On 03/20/2018 12:49 AM, Robert Scavilla wrote:
> Hi, I'm stuck on this problem and would appreciate any help. I'm using
> nutch 1.11
> plugin-includes:
> protocol-http|urlfilter-regex
> 
> Running indexchecker generates error for only one site:
>> apache-nutch-1.11/runtime/local/bin/nutch indexchecker https://potomac.edu/
> 
> Error message:
> httpclient.Http - Failed to get protocol output
> javax.net.ssl.SSLHandshakeException: Received fatal alert: handshake_failure
> 
> I've manually added certificate in cacerts file
> 
> I'm out of ideas - thank you for helping,
> ...bob
>