2017-08-22
Arbitrary stopping of the crawl.
Hello, need help with the configuring of a search engine . After running the bypass after some time stops (visited URLS count stops).
In the log queue server says:
Scheduler: No fetch batch
created!! Time failing to make a fetch
In the log Fetchers :
No data. Sleeping...
with respect, Nik
(Edited: 2017-08-26) Hello, need help with the configuring of a search engine . After running the bypass after some time stops (visited URLS count stops).
In the log queue server says:
Scheduler: No fetch batch
created!! Time failing to make a fetch
In the log Fetchers :
No data. Sleeping...
with respect, Nik
2017-08-30
My guess is that means it couldn't find anything else to crawl so it stopped. The likely cause for this is that you have restricted what it's allowed to crawl too much.
Best,
Chris
My guess is that means it couldn't find anything else to crawl so it stopped. The likely cause for this is that you have restricted what it's allowed to crawl too much.
Best,
Chris
2017-09-08
Hi. Can help what settings to change to my server (VPS, 2 GB memory, 2.4 GHz processor) ?
Memory limit in php.ini , URL_FILTER_SIZE in config.php , memory_limit in fetcher.php or QueueServer.php ? It is very kind of you to answer me, i sincerely appreciate your help, thanks! Nik
Hi. Can help what settings to change to my server (VPS, 2 GB memory, 2.4 GHz processor) ?
Memory limit in php.ini , URL_FILTER_SIZE in config.php , memory_limit in fetcher.php or QueueServer.php ? It is very kind of you to answer me, i sincerely appreciate your help, thanks! Nik
(c) 2024 Yioop - PHP Search Engine