[jira] [Commented] (NUTCH-2676) Update to the latest selenium and add code to use chrome and firefox headless mode with the remote web driver

2019-02-23 Thread Hudson (JIRA) 


[ 
https://issues.apache.org/jira/browse/NUTCH-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776074#comment-16776074
 ] 

Hudson commented on NUTCH-2676:
---

FAILURE: Integrated in Jenkins build Nutch-trunk #3613 (See 
[https://builds.apache.org/job/Nutch-trunk/3613/])
NUTCH-2676 Update to the latest selenium and add code to use chrome and 
(snagel: 
[https://github.com/apache/nutch/commit/8f421a4114f2d3e5be8726ca735766c6b9b19dbb])
* (edit) conf/nutch-default.xml
* (edit) src/plugin/lib-selenium/plugin.xml
* (add) src/plugin/lib-selenium/README.md
* (edit) .gitignore
* (edit) 
src/plugin/lib-selenium/src/java/org/apache/nutch/protocol/selenium/HttpWebClient.java
* (edit) src/plugin/lib-selenium/ivy.xml
* (edit) src/plugin/lib-selenium/build-ivy.xml


> Update to the latest selenium and add code to use chrome and firefox headless 
> mode with the remote web driver
> -
>
> Key: NUTCH-2676
> URL: https://issues.apache.org/jira/browse/NUTCH-2676
> Project: Nutch
>  Issue Type: New Feature
>  Components: protocol
>Affects Versions: 1.15
>Reporter: Stas Batururimi
>Priority: Major
> Fix For: 1.16
>
> Attachments: Screenshot 2018-11-16 at 18.15.52.png
>
>
> * Selenium needs to be updated
>  * missing remote web driver for chrome 
>  * necessity to add headless mode for both remote WebDriverBase Firefox & 
> Chrome
>  * use case with Selenium grid using docker (1 hub docker container, several 
> nodes in different docker containers, Nutch in another docker container, 
> streaming to Apache Solr in docker container, that is at least 4 different 
> docker containers)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: Nutch-trunk #3613

2019-02-23 Thread Apache Jenkins Server 
See 


Changes:

[snagel] NUTCH-2676 Update to the latest selenium and add code to use chrome and

--
[...truncated 6.21 KB...]
[javac] import com.j256.ormlite.field.ForeignCollectionField;
[javac]  ^
[javac]   symbol:   class ForeignCollectionField
[javac]   location: package com.j256.ormlite.field
[javac] 
:29:
 error: cannot find symbol
[javac] import com.j256.ormlite.field.DatabaseField;
[javac]  ^
[javac]   symbol:   class DatabaseField
[javac]   location: package com.j256.ormlite.field
[javac] 
:28:
 error: cannot find symbol
[javac] import com.j256.ormlite.field.DatabaseField;
[javac]  ^
[javac]   symbol:   class DatabaseField
[javac]   location: package com.j256.ormlite.field
[javac] 
:24:
 error: cannot find symbol
[javac] import com.j256.ormlite.dao.Dao;
[javac]^
[javac]   symbol:   class Dao
[javac]   location: package com.j256.ormlite.dao
[javac] 
:26:
 error: cannot find symbol
[javac] import com.j256.ormlite.support.ConnectionSource;
[javac]^
[javac]   symbol:   class ConnectionSource
[javac]   location: package com.j256.ormlite.support
[javac] 
:29:
 error: cannot find symbol
[javac]   private ConnectionSource connectionSource;
[javac]   ^
[javac]   symbol:   class ConnectionSource
[javac]   location: class CustomDaoFactory
[javac] 
:30:
 error: cannot find symbol
[javac]   private List> registredDaos = Collections
[javac]^
[javac]   symbol:   class Dao
[javac]   location: class CustomDaoFactory
[javac] 
:33:
 error: cannot find symbol
[javac]   public CustomDaoFactory(ConnectionSource connectionSource) {
[javac]   ^
[javac]   symbol:   class ConnectionSource
[javac]   location: class CustomDaoFactory
[javac] 
:37:
 error: cannot find symbol
[javac]   public  Dao createDao(Class clazz) {
[javac]  ^
[javac]   symbol:   class Dao
[javac]   location: class CustomDaoFactory
[javac] 
:47:
 error: cannot find symbol
[javac]   private  void register(Dao dao) {
[javac] ^
[javac]   symbol:   class Dao
[javac]   location: class CustomDaoFactory
[javac] 
:53:
 error: cannot find symbol
[javac]   public List> getCreatedDaos() {
[javac]   ^
[javac]   symbol:   class Dao
[javac]   location: class CustomDaoFactory
[javac] 
:22:
 error: cannot find symbol
[javac] import com.j256.ormlite.dao.BaseDaoImpl;
[javac]^
[javac]   symbol:   class BaseDaoImpl
[javac]   location: package com.j256.ormlite.dao
[javac] 
:23:
 error: cannot find symbol
[javac] import com.j256.ormlite.dao.Dao;
[javac]^
[javac]   symbol:   class Dao
[javac]   location: package com.j256.ormlite.dao
[javac] 
:25:
 error: cannot find symbol
[javac] import com.j256.ormlite.table.DatabaseTableConfig;
[javac]  ^
[javac]   symbol:   class DatabaseTableConfig
[javac]   location: package com.j256.ormlite.table
[javac] 
:26:
 error: cannot find symbol
[javac]

[jira] [Commented] (NUTCH-2460) use the headless option of firefox and chrome in protocol-selenium

2019-02-23 Thread ASF GitHub Bot (JIRA) 


[ 
https://issues.apache.org/jira/browse/NUTCH-2460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776069#comment-16776069
 ] 

ASF GitHub Bot commented on NUTCH-2460:
---

sebastian-nagel commented on pull request #245: fix for NUTCH-2460 contributed 
by Hussein Alahmad
URL: https://github.com/apache/nutch/pull/245
 
 
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> use the headless option of firefox and chrome in protocol-selenium
> --
>
> Key: NUTCH-2460
> URL: https://issues.apache.org/jira/browse/NUTCH-2460
> Project: Nutch
>  Issue Type: Improvement
>  Components: plugin, protocol
>Affects Versions: 1.14
>Reporter: hussein Al_Ahmad
>Priority: Minor
> Fix For: 1.16
>
>
> the --headless option is added to firefox in version 55 or later , and in 
> chrome in version 59 or later ...
> this is much better than relying on  xvfb and its associates .
> we can add it as a property in the config file .
> I'm trying it on my local machine , and will create a pull request when I 
> finish testing it .



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Resolved] (NUTCH-2460) use the headless option of firefox and chrome in protocol-selenium

2019-02-23 Thread Sebastian Nagel (JIRA) 


 [ 
https://issues.apache.org/jira/browse/NUTCH-2460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sebastian Nagel resolved NUTCH-2460.

Resolution: Implemented

Implemented as part of NUTCH-2676.

> use the headless option of firefox and chrome in protocol-selenium
> --
>
> Key: NUTCH-2460
> URL: https://issues.apache.org/jira/browse/NUTCH-2460
> Project: Nutch
>  Issue Type: Improvement
>  Components: plugin, protocol
>Affects Versions: 1.14
>Reporter: hussein Al_Ahmad
>Priority: Minor
> Fix For: 1.16
>
>
> the --headless option is added to firefox in version 55 or later , and in 
> chrome in version 59 or later ...
> this is much better than relying on  xvfb and its associates .
> we can add it as a property in the config file .
> I'm trying it on my local machine , and will create a pull request when I 
> finish testing it .



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (NUTCH-2460) use the headless option of firefox and chrome in protocol-selenium

2019-02-23 Thread ASF GitHub Bot (JIRA) 


[ 
https://issues.apache.org/jira/browse/NUTCH-2460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776068#comment-16776068
 ] 

ASF GitHub Bot commented on NUTCH-2460:
---

sebastian-nagel commented on issue #245: fix for NUTCH-2460 contributed by 
Hussein Alahmad
URL: https://github.com/apache/nutch/pull/245#issuecomment-466709764
 
 
   Included in #430 / dfd8602. Thanks, @hussein-alahmad and @sbatururimi!
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> use the headless option of firefox and chrome in protocol-selenium
> --
>
> Key: NUTCH-2460
> URL: https://issues.apache.org/jira/browse/NUTCH-2460
> Project: Nutch
>  Issue Type: Improvement
>  Components: plugin, protocol
>Affects Versions: 1.14
>Reporter: hussein Al_Ahmad
>Priority: Minor
> Fix For: 1.16
>
>
> the --headless option is added to firefox in version 55 or later , and in 
> chrome in version 59 or later ...
> this is much better than relying on  xvfb and its associates .
> we can add it as a property in the config file .
> I'm trying it on my local machine , and will create a pull request when I 
> finish testing it .



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Resolved] (NUTCH-2676) Update to the latest selenium and add code to use chrome and firefox headless mode with the remote web driver

2019-02-23 Thread Sebastian Nagel (JIRA) 


 [ 
https://issues.apache.org/jira/browse/NUTCH-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sebastian Nagel resolved NUTCH-2676.

Resolution: Fixed

Tested again successfully chrome and gecko drivers. Merged PR #430. Thanks, 
[~virt]!

> Update to the latest selenium and add code to use chrome and firefox headless 
> mode with the remote web driver
> -
>
> Key: NUTCH-2676
> URL: https://issues.apache.org/jira/browse/NUTCH-2676
> Project: Nutch
>  Issue Type: New Feature
>  Components: protocol
>Affects Versions: 1.15
>Reporter: Stas Batururimi
>Priority: Major
> Fix For: 1.16
>
> Attachments: Screenshot 2018-11-16 at 18.15.52.png
>
>
> * Selenium needs to be updated
>  * missing remote web driver for chrome 
>  * necessity to add headless mode for both remote WebDriverBase Firefox & 
> Chrome
>  * use case with Selenium grid using docker (1 hub docker container, several 
> nodes in different docker containers, Nutch in another docker container, 
> streaming to Apache Solr in docker container, that is at least 4 different 
> docker containers)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)