It would help, if it was possible to order the crawled links in the same way as we can do it with indexed links on which bot is trained. For example, that I would be able to order the crawled links by the character count going from highest to lowest.
To leave a comment, please authenticate.
