15/01/2020

Classifier / Onion.

Hello Chris, there are two problems at the moment, and I hope that you will help me again) The first problem is this, the classifier does not work. That is, classifier training does not work. I go into the classifiers, change, interfere with the last round, write some keyword and click download, at this moment the examples for the classifier should load, but always writes No Data ..... I have already tried hundreds of methods and nothing helps. In my opinion this is a very necessary function.
The second problem is the reluctance to work with onion links. very rarely, one or two pages out of several hundred are indexed. I assume that there is a problem with DNS, with certificates and httpS: // addresses.
Also, apparently, onion links are not collected from indexed sites.
And also another question, the last entry is often fetcher turned off, in the logs: Start building mini inverted index ... Current Memory: 94145128
it only turns off fetchers, everything else works, but indexing stops. this occurs approximately one and a half to two hours after launch crawl. if you just go to the "machines" menu and turn fetcher ON, then indexing continues. is there some kind of timeout? why does it turn off Fetchers?
Hello Chris, there are two problems at the moment, and I hope that you will help me again) The first problem is this, the classifier does not work. That is, classifier training does not work. I go into the classifiers, change, interfere with the last round, write some keyword and click download, at this moment the examples for the classifier should load, but always writes No Data ..... I have already tried hundreds of methods and nothing helps. In my opinion this is a very necessary function. The second problem is the reluctance to work with onion links. very rarely, one or two pages out of several hundred are indexed. I assume that there is a problem with DNS, with certificates and httpS: // addresses. Also, apparently, onion links are not collected from indexed sites. And also another question, the last entry is often fetcher turned off, in the logs: Start building mini inverted index ... Current Memory: 94145128 it only turns off fetchers, everything else works, but indexing stops. this occurs approximately one and a half to two hours after launch crawl. if you just go to the "machines" menu and turn fetcher ON, then indexing continues. is there some kind of timeout? why does it turn off Fetchers?

-- Classifier / Onion
And of course, finally the pictures) Yes, I know the topic with pictures has already been raised, But in the latest versions they somehow started to appear quite strange, they are now displayed as links and not pictures ...
And of course, finally the pictures) Yes, I know the topic with pictures has already been raised, But in the latest versions they somehow started to appear quite strange, they are now displayed as links and not pictures ...
[X ]