I'm trying to scrap a set of data. To get the data needed I have to go
through a certain "gate" where I have to determine filters for a form that
uses onclick="__doPostBack('search','')" in order to get the list of data
to scrap. (this is the "gate" url = "http://www.rekrute.com/search_area.php
")
As you can imagine I didn't succeed...What I'm doing can be summarized
(using the shell) as follow :
from scrappy.http import FormRequest
data = {
"__EVENTTARGET": "search",
"_STATE_":"",
"__EVENTARGUMENT":"",
"jobOffer_Sector_2":"",
"searchquery":"",
"jobOffer_Country[]":"134"}
req = FormRequest.from_response(response, formdata=data)
The reqvariable shows <POST http://www.rekrute.com/home.php>...what I was
expecting is something like <POST http://www.rekrute.com/search_area.php>.
So here I'm little bit confused.
Am I doing it all wrong? I tried to read many issues on this matter
(scrappy and __doPostBack) maybe I'm not having the right information to
deal with it.
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.