Yes, but now use a different proxy lists (to me not blocked website), for each request a new proxy address. I.e. I probably won't be able to use browsermob-proxy-rb. If you understood everything correctly (sorry, I'm not a native English speaker, so some sentences difficult to understand).
четверг, 11 декабря 2014 г., 21:55:41 UTC+3 пользователь Titus Fortner написал: > > Using a proxy is your best bet, then. Just filtering out FB & Google can > give site loading speed a huge boost, and potentially help with unnecessary > slow loading images, etc as well. > > On Thu, Dec 11, 2014 at 12:31 PM, Alexander Alyoshin < > [email protected] <javascript:>> wrote: > >> Unfortunately, I can't. I need to parse the page of the public website, but >> it works very slowly. So I wanted to download only part of the page. Tried >> to work with cURL, but the site is blocking such requests (the site is using >> a incapsula). So I need to simulate the user. And Watir for this ideal, >> although >> it is slow. >> >> >> четверг, 11 декабря 2014 г., 21:22:05 UTC+3 пользователь Titus Fortner >> написал: >>> >>> That is part of the webdriver spec - https://dvcs.w3.org/hg/ >>> webdriver/raw-file/default/webdriver-spec.html#page-load-strategies-1 >>> The purpose of Watir is to interact with the website like a user (which >>> means waiting for the page to load before using it). If you just want to >>> get the data, it would be much faster to just use an HTML library. >>> >>> Titus >>> >>> On Thu, Dec 11, 2014 at 12:13 PM, Alexander Alyoshin < >>> [email protected]> wrote: >>> >>>> This is bad. I thought you somehow get the data from the page in the >>>> stream or in part. >>>> >>>> четверг, 11 декабря 2014 г., 21:03:23 UTC+3 пользователь Titus Fortner >>>> написал: >>>>> >>>>> The only blocking action taking place in Watir is for page load >>>>> itself, not for javascript afterward. Webdriver will always wait for the >>>>> page to return from a page load before allowing further actions to be >>>>> taken. The only way to speed up page loads would be to run your tests >>>>> through a proxy (https://github.com/jarib/browsermob-proxy-rb) that >>>>> blacklists the things you don't want. >>>>> >>>>> >>>>> On Thu, Dec 11, 2014 at 11:46 AM, Alexander Alyoshin < >>>>> [email protected]> wrote: >>>>> >>>>>> >>>>>> guys? >>>>>> >>>>>> вторник, 9 декабря 2014 г., 16:45:42 UTC+3 пользователь Alexander >>>>>> Alyoshin написал: >>>>>> >>>>>>> Sometimes the site loads very long time, so watir will wait until it >>>>>>> is fully loaded (at the end of the page is loaded the script, google, >>>>>>> Analytics, and so on). How to make he didn’t do it? I wish he didn’t >>>>>>> wait >>>>>>> until it loads all the scripts, and gave me the html as soon as >>>>>>> possible. >>>>>>> >>>>>> -- >>>>>> -- >>>>>> Before posting, please read http://watir.com/support. In short: >>>>>> search before you ask, be nice. >>>>>> >>>>>> [email protected] >>>>>> http://groups.google.com/group/watir-general >>>>>> [email protected] >>>>>> >>>>>> --- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "Watir General" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to [email protected]. >>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>> >>>>> >>>>> -- >>>> -- >>>> Before posting, please read http://watir.com/support. In short: search >>>> before you ask, be nice. >>>> >>>> [email protected] >>>> http://groups.google.com/group/watir-general >>>> [email protected] >>>> >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "Watir General" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> -- >> -- >> Before posting, please read http://watir.com/support. In short: search >> before you ask, be nice. >> >> [email protected] <javascript:> >> http://groups.google.com/group/watir-general >> [email protected] <javascript:> >> >> --- >> You received this message because you are subscribed to the Google Groups >> "Watir General" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected] <javascript:>. >> For more options, visit https://groups.google.com/d/optout. >> > > -- -- Before posting, please read http://watir.com/support. In short: search before you ask, be nice. [email protected] http://groups.google.com/group/watir-general [email protected] --- You received this message because you are subscribed to the Google Groups "Watir General" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
