H hihotfile Active Member 145 2010 35 0 Feb 20, 2016 #1 what will be best/fastest solution for scrape 1 M url.php+CURL , Python
N normalperson Member 9 2014 2 0 Feb 22, 2016 #2 It would be scrapy (Python's framework) - I used it and it seems to be really fast and easy CURL would make you die if you want to use PHP than use reactphp but really, that would be more difficult than scrapy
It would be scrapy (Python's framework) - I used it and it seems to be really fast and easy CURL would make you die if you want to use PHP than use reactphp but really, that would be more difficult than scrapy
H hulkcoder New Member 1 2016 0 0 Mar 5, 2016 #3 Guzzle PHP has the option of asynchronous requests as well this might help
