if it got an error "Service Unavailable" back, it should stop, wait for 5min and continue.
Reason: After every 500 requests per IP it stops to return results to combat scrapers and spammers like us
Question: is a cronjob needed for this or will the php file continue to run by itself?
if it got an error "Service Unavailable" back, it should stop, wait for 5min and continue.
Reason: After every 500 requests per IP it stops to return results to combat scrapers and spammers like us
Question: is a cronjob needed for this or will the php file continue to run by itself?