-
Notifications
You must be signed in to change notification settings - Fork 409
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Not working with scrapy-splash #38
Comments
lua_script = """
function main(splash, args)
assert(splash:go{splash.args.url,http_method=splash.args.http_method,body=splash.args.body})
assert(splash:wait(0.5))
splash:on_request(function(request)
request:set_proxy{
host = "http://%s",
port = %s
}
end)
return splash:html()
end
""" % (proxy_ip, proxy_port)
yield SplashRequest(shop_url, callback=self.parse_content,
headers={'Referer:': response.url},
endpoint='execute',
args={'lua_source': lua_script}) |
Do you have a working solution ? I have the same problem and do not know how to do |
@Pierrorobis No |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I'm using
scrapy-splash
to crawl an ajax site. And when usingscrapy-proxies
, it seems that the request is not sending through the proxy, the proxy is not working at all.The text was updated successfully, but these errors were encountered: