Comments on: Learning to crawl before you can run http://wheresrhys.co.uk/2009/07/learning-to-crawl-before-you-can-run/ on the internet Sat, 07 Apr 2012 14:54:41 +0000 hourly 1 http://wordpress.org/?v=3.0.5 By: wheresrhys http://wheresrhys.co.uk/2009/07/learning-to-crawl-before-you-can-run/comment-page-1/#comment-1918 wheresrhys Wed, 16 Sep 2009 06:29:41 +0000 http://wheresrhys.co.uk/?p=732#comment-1918 My eventual solution to the timeout involved using AJAX to send the repeated requests, thereby allowing me to repeatedly reload the php page while keeping the browser window in the dark, so to speak, about what was going on. http://wheresrhys.co.uk/2009/08/geocoding-in-the-uk/. I did look into running scheduled tasks but my hosting provider wouldnt let me run scheduled php CGIs, which is why I turned t a browser reload solution. I didnt use set_time_limit(0), though I think the issue is more to do with browsers not liking pages taht request themselves ad infinitum, rather than a problem with the page itself. My eventual solution to the timeout involved using AJAX to send the repeated requests, thereby allowing me to repeatedly reload the php page while keeping the browser window in the dark, so to speak, about what was going on. http://wheresrhys.co.uk/2009/08/geocoding-in-the-uk/. I did look into running scheduled tasks but my hosting provider wouldnt let me run scheduled php CGIs, which is why I turned t a browser reload solution.

I didnt use set_time_limit(0), though I think the issue is more to do with browsers not liking pages taht request themselves ad infinitum, rather than a problem with the page itself.

]]> By: gt http://wheresrhys.co.uk/2009/07/learning-to-crawl-before-you-can-run/comment-page-1/#comment-1890 gt Tue, 15 Sep 2009 01:11:25 +0000 http://wheresrhys.co.uk/?p=732#comment-1890 I'm faced with a similar problem for a website I'm writing at the moment. Have you looked at calling set_time_limit(0) to prevent the PHP engine from timing out? Otherwise, your web host may allow 'scheduled tasks' to be run via their admin pages, which could be used to re-start a PHP script every few minutes. I’m faced with a similar problem for a website I’m writing at the moment.

Have you looked at calling set_time_limit(0) to prevent the PHP engine from timing out?

Otherwise, your web host may allow ‘scheduled tasks’ to be run via their admin pages, which could be used to re-start a PHP script every few minutes.

]]>