Using a proxy is your best bet, then. Just filtering out FB & Google can give site loading speed a huge boost, and potentially help with unnecessary slow loading images, etc as well.
On Thu, Dec 11, 2014 at 12:31 PM, Alexander Alyoshin < [email protected]> wrote: > Unfortunately, I can't. I need to parse the page of the public website, but > it works very slowly. So I wanted to download only part of the page. Tried > to work with cURL, but the site is blocking such requests (the site is using > a incapsula). So I need to simulate the user. And Watir for this ideal, > although > it is slow. > > > четверг, 11 декабря 2014 г., 21:22:05 UTC+3 пользователь Titus Fortner > написал: >> >> That is part of the webdriver spec - https://dvcs.w3.org/hg/ >> webdriver/raw-file/default/webdriver-spec.html#page-load-strategies-1 >> The purpose of Watir is to interact with the website like a user (which >> means waiting for the page to load before using it). If you just want to >> get the data, it would be much faster to just use an HTML library. >> >> Titus >> >> On Thu, Dec 11, 2014 at 12:13 PM, Alexander Alyoshin < >> [email protected]> wrote: >> >>> This is bad. I thought you somehow get the data from the page in the >>> stream or in part. >>> >>> четверг, 11 декабря 2014 г., 21:03:23 UTC+3 пользователь Titus Fortner >>> написал: >>>> >>>> The only blocking action taking place in Watir is for page load itself, >>>> not for javascript afterward. Webdriver will always wait for the page to >>>> return from a page load before allowing further actions to be taken. The >>>> only way to speed up page loads would be to run your tests through a proxy >>>> ( >>>> https://github.com/jarib/browsermob-proxy-rb) that blacklists the >>>> things you don't want. >>>> >>>> >>>> On Thu, Dec 11, 2014 at 11:46 AM, Alexander Alyoshin < >>>> [email protected]> wrote: >>>> >>>>> >>>>> guys? >>>>> >>>>> вторник, 9 декабря 2014 г., 16:45:42 UTC+3 пользователь Alexander >>>>> Alyoshin написал: >>>>> >>>>>> Sometimes the site loads very long time, so watir will wait until it >>>>>> is fully loaded (at the end of the page is loaded the script, google, >>>>>> Analytics, and so on). How to make he didn’t do it? I wish he didn’t wait >>>>>> until it loads all the scripts, and gave me the html as soon as possible. >>>>>> >>>>> -- >>>>> -- >>>>> Before posting, please read http://watir.com/support. In short: >>>>> search before you ask, be nice. >>>>> >>>>> [email protected] >>>>> http://groups.google.com/group/watir-general >>>>> [email protected] >>>>> >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "Watir General" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to [email protected]. >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> >>>> -- >>> -- >>> Before posting, please read http://watir.com/support. In short: search >>> before you ask, be nice. >>> >>> [email protected] >>> http://groups.google.com/group/watir-general >>> [email protected] >>> >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Watir General" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- > -- > Before posting, please read http://watir.com/support. In short: search > before you ask, be nice. > > [email protected] > http://groups.google.com/group/watir-general > [email protected] > > --- > You received this message because you are subscribed to the Google Groups > "Watir General" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- -- Before posting, please read http://watir.com/support. In short: search before you ask, be nice. [email protected] http://groups.google.com/group/watir-general [email protected] --- You received this message because you are subscribed to the Google Groups "Watir General" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
