Hi, am trying to see if I can make a GWT site more crawlable by detecting whenever a web bot visits, I'd invoke HtmlUnit to download (internally) the web page and return to the bot.
Thanks but that URL was copied from my browser window after having found the site and loaded it in the browser so it's accessible.
It is also complaining about CSS with the following...
Joined: Mar 22, 2005
If the server sends malformed CSS then there's nothing HtmUnit can do about that. But for the purposes HtmlUnit is used CSS problems are generally inconseqeuntial. I think there's some configuration setting through which CSS error reporting can be turned off.