I'm not sure if this is the best place to post but here goes.
I have a custom 404 page set-up on my server and, upon an unsuccessful search, I manage to get that 404 page. Is there a way to tell web crawlers that this page is really a 404 error page (i.e. return status 404 to it)?
Setting a custom 404 page on the server. Had to set the 404 link to be a File (not URL) first off. When checking what the status code was from the custom 404 page it was giving a 200 status code. Some more tinkering got it working.
I’ve looked at a lot of different solutions, and in my humble opinion Aspose is the way to go. Here’s the link: http://aspose.com
subject: Custom 404 error pages and webcrawler results