Looking for ntesters - Nutch Dockerfile
Hi user@, Are you interested in the Nutch Dockerfile? If so, keep reading. We are looking for some assistance to test proposed additions to the Nutch Dockerfile. Essentially the changes would facilitate installing and running the Nutch REST server and/or the Nutch WebApp in addition to the Nutch server-side installation. How to build and run is all documented in the accompanying README If you are interested, please see https://github.com/apache/nutch/pull/691 ..and comment in the thread. Thanks lewismc
Re: Crawling pages behind SSO authentication (SAML/OIDC)
Hi Abhay, On 2021/06/10 22:27:42, Abhay Ratnaparkhi wrote: > > Based on selenium I created a microservice (which handles all required SSO > redirections/ OTP handlings etc) and hosted that with a selenium grid in > the kubernetes cluster for scaling. > I found that we couldn't scale this approach beyond a certain point and the > selenium hub in the selenium grid can not be scaled horizontally. Which version of Selenium Grid and Hub did you use? I haven't used either for a while... I did see that Grid 4 is available https://www.selenium.dev/documentation/en/grid/grid_4/ lewismc
