I've put together a search engine, Wild Hunt, with a focus on vintage computer resources. It's running on YaCY, which allows you to tweak crawling for each site. For instance, when indexing a forum, I only include forum posts, not indexes or user lists. The VCFed forum is not yet indexed, because it's not crawling XenForo sites correctly. I can share more information on that here, if anybody's interested.
I'm publicly sharing my crawler settings. I'm welcome to feedback on what sites to include (especially with crawler settings) and how to tweak the current settings.
I put this in Services Offered/Needed, since it is technically both. I don't mind if it's moved.
I'm publicly sharing my crawler settings. I'm welcome to feedback on what sites to include (especially with crawler settings) and how to tweak the current settings.
I put this in Services Offered/Needed, since it is technically both. I don't mind if it's moved.