php - cURL can't connect through working proxies? -
i have script tests compiled list of http proxies see if can connect specified website. if connect, , correct page results returned, added list of working proxies; however, if test 30,000 proxies @ time....none of them come working.
yet, when check random selection of them in proxy checker, quite large portion of them come working.
http://puu.sh/3ejdo.png (picture of connection results)
even when specify proxy type http, curl never manages make connection webpage , return webpage contents.
note: setting user-agent.
as can see, no results returned. contents of webpage, if retrieved, should posted in textbox.
don't think help, here's curl request setup:
foreach($proxies $proxy){ $proxy_split = explode(':',$proxy); if(!in_array($proxy_split[1], $this->banned_ports)){ $checked[] = $proxy; $this->curl->addsession('http://www.removed.com', array( curlopt_proxy => $proxy, curlopt_proxytype => curlproxy_http, curlopt_timeout => 60, curlopt_useragent => 'mozilla/5.0 (windows nt 6.1; wow64; rv:14.0) gecko/20100101 firefox/14.0.1', curlopt_returntransfer => true )); } }
added curlopt_followlocation option double check, , still not manage return page contents/make connection.
Comments
Post a Comment